-- Logs begin at Wed 2022-08-24 02:44:23 UTC, end at Wed 2022-08-24 03:54:35 UTC. -- Aug 24 03:23:32.178054 dv-cinder-854260-1-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:23:32.186974 dv-cinder-854260-1-smb devstack@n-api.service[105570]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:23:32 2022] *** Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: nodename: dv-cinder-854260-1-smb Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: machine: x86_64 Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: clock source: unix Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: pcre jit disabled Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: detected number of CPU cores: 4 Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: current working directory: / Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: your processes number limit is 47680 Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: your memory page size is 4096 bytes Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: detected max file descriptor number: 2048 Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: lock engine: pthread robust mutexes Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: thunder lock: enabled Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:23:32.189623 dv-cinder-854260-1-smb devstack@n-api.service[105570]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:23:32.229681 dv-cinder-854260-1-smb devstack@n-api.service[105570]: Python main interpreter initialized at 0x5588a12cf9c0 Aug 24 03:23:32.229681 dv-cinder-854260-1-smb devstack@n-api.service[105570]: python threads support enabled Aug 24 03:23:32.229681 dv-cinder-854260-1-smb devstack@n-api.service[105570]: your server socket listen backlog is limited to 100 connections Aug 24 03:23:32.229681 dv-cinder-854260-1-smb devstack@n-api.service[105570]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:23:32.230268 dv-cinder-854260-1-smb devstack@n-api.service[105570]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:23:32.230268 dv-cinder-854260-1-smb devstack@n-api.service[105570]: *** Operational MODE: preforking *** Aug 24 03:23:32.230395 dv-cinder-854260-1-smb devstack@n-api.service[105570]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:23:32.230395 dv-cinder-854260-1-smb devstack@n-api.service[105570]: spawned uWSGI master process (pid: 105570) Aug 24 03:23:32.230549 dv-cinder-854260-1-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:23:32.232684 dv-cinder-854260-1-smb devstack@n-api.service[105570]: spawned uWSGI worker 1 (pid: 105582, cores: 1) Aug 24 03:23:32.232684 dv-cinder-854260-1-smb devstack@n-api.service[105570]: spawned uWSGI worker 2 (pid: 105583, cores: 1) Aug 24 03:23:32.233091 dv-cinder-854260-1-smb devstack@n-api.service[105570]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:23:32.887275 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:23:32.890505 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:23:33.968205 dv-cinder-854260-1-smb devstack@n-api.service[105583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:23:33.968205 dv-cinder-854260-1-smb devstack@n-api.service[105583]: from cryptography.utils import int_from_bytes Aug 24 03:23:33.968825 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:23:33.968825 dv-cinder-854260-1-smb devstack@n-api.service[105582]: from cryptography.utils import int_from_bytes Aug 24 03:23:33.969235 dv-cinder-854260-1-smb devstack@n-api.service[105583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:23:33.969235 dv-cinder-854260-1-smb devstack@n-api.service[105583]: from cryptography.utils import int_from_bytes Aug 24 03:23:33.969346 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:23:33.969346 dv-cinder-854260-1-smb devstack@n-api.service[105582]: from cryptography.utils import int_from_bytes Aug 24 03:23:36.474483 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:23:36.475190 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:23:36.475520 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:23:36.475986 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:23:36.476240 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:23:36.476658 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.476904 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:23:36.477261 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.477424 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:23:36.477492 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.477665 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.477769 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:23:36.477989 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.478112 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:23:36.478281 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:23:36.478378 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.478610 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.478715 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.478950 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.479050 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.479277 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.479364 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.479537 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.479623 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.479850 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.479936 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.480173 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-smb {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.480259 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.480485 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.480595 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.480792 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.480887 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.481150 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.481257 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.481451 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.481557 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.481756 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.481850 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.482072 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-smb {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.482179 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.482369 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.482488 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.482700 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.482889 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.483012 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.483296 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.483432 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.483591 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.483726 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.483906 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.484025 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.484205 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.484338 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.484534 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.484707 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.484837 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.485010 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.485151 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.485306 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.485457 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.485603 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.485780 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.485923 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.486084 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.486230 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.486495 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-smb {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.486591 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.486848 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.486996 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.487137 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.487266 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.487450 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.487581 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.487751 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.487885 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.488159 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.488299 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-smb {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.488446 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.488544 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.488756 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.488843 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.489063 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.489157 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.489368 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.489454 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.489693 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.489787 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.490008 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.490100 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.490323 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.490420 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.490640 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.490767 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.490961 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.491047 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.491265 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.491357 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.491569 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.491668 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.491878 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.491963 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.492178 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.492262 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.492474 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.492579 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.492719 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.492865 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.493021 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.493108 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.493337 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.493430 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.493644 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.493728 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.493941 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.494027 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.494186 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.494272 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.494430 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.494516 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.494769 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.494876 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.495086 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.495180 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.495392 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.495489 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.495642 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.495775 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.495889 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.496039 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.496199 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.496286 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.496512 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.496608 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.496886 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.497101 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.497546 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.497634 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.497634 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.497787 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.497872 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.497951 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.498055 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.498170 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.498368 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.498459 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.498685 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.498772 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.499038 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.499152 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.499316 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.499403 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.499623 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.499707 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.499926 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.500020 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.500223 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.500308 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.500535 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.500621 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.500844 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.500937 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.501160 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.501253 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.501460 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.501546 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.501762 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.501855 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.502062 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.502148 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.502363 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.502448 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.502684 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.502786 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503000 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503085 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503301 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503556 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503642 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503855 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.503942 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.504157 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.504241 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.504471 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.504566 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.504767 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.504852 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.505014 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.505100 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.505308 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.505396 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.505606 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.505706 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.505916 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.506012 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.506211 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.506307 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.506509 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.506602 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.506830 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.506932 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.507126 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.507211 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.507424 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.507509 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.507720 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.507821 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508017 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508107 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508311 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508402 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508606 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508705 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508899 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.508983 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.509199 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.509284 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.509496 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.509596 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.509791 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.509876 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.510089 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.510173 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.510395 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.510494 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.510711 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.510802 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511014 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511102 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511308 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511406 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511605 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511692 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511904 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.511988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.512199 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.512538 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.512670 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.512829 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.512917 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.513159 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.513297 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.513458 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.513553 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.513762 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.513849 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.514072 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.514171 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.514375 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.514460 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.514693 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.514784 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.514996 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.515099 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.515293 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.515381 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.515591 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.515677 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.515917 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.516047 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.516190 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.516282 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.516488 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.516574 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.516782 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.516879 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.517075 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.517160 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.517373 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.517466 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.517670 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.517791 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.517967 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.518053 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.518265 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.518358 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.518555 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.518643 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.518889 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.518975 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.519201 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.519296 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.519504 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.519591 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.519805 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.519890 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.520104 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.520189 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.520414 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:23:36.520500 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.520745 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.520837 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.521077 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.521185 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.521383 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.521468 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.521706 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.521802 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.522007 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.522103 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.522318 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.522414 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.522622 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.522757 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.522952 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.523048 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.523263 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.523350 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.523579 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.523665 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.523967 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.524068 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.524189 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.524369 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.524494 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.524581 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.524799 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.524893 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.525106 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.525194 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.525427 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.525513 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.525737 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.525833 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.526041 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.526182 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.526352 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.526439 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.526679 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.526769 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.526989 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.527075 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.527309 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.527406 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.527667 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.527768 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.528060 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.528198 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.528664 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.528761 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.528855 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529099 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529259 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529259 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529591 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529727 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529823 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529912 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.529992 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.530121 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.530288 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.530431 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.530597 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.530762 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.530938 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.531074 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.531256 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.531385 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.531585 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.531720 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.531893 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.532035 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.532206 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.532407 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.532505 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.532661 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.532806 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.532983 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.533108 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.533288 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.533414 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.533596 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.533718 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.533907 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.534051 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.534210 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.534356 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.534513 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.534685 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.534844 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.534992 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.535152 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.535302 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.535455 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.535607 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.535773 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.535910 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.536103 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.536228 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.536408 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.536494 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.536738 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.536837 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.537040 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.537133 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.537346 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.537433 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.537641 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.537727 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.537954 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.538075 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.538256 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.538341 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.538556 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.538699 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.538896 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.538989 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.539191 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.539276 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.539495 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.539581 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.539799 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.539884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.540097 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.540181 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.540397 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.540489 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.540703 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.540794 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.541004 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.541110 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.541401 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.541501 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.541604 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.541689 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.541906 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.542001 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.542206 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.542301 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.542587 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.542714 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.542834 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.542930 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.543133 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.543227 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.543444 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.543685 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.543986 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.544429 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.544526 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.544608 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.544685 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.544763 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.544850 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.544930 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.545055 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.545197 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.545365 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.545507 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.545667 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.545817 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.545971 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.546147 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.546280 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.546473 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.546568 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.546796 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.546885 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.547114 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.547199 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.547433 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.547529 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.547740 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.547826 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.548038 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.548167 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.548337 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.548425 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.548632 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.548715 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.548932 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.549017 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.549230 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.549324 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.549529 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.549613 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.549822 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.549914 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.550119 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.550213 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.550422 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.550506 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.550742 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.550845 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.551041 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.551127 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.551354 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.551440 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.551655 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.551829 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.551952 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.552039 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.552248 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.552341 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.552543 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.552639 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.552901 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.553021 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.553176 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.553263 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.553500 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.553599 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.553839 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.553936 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.554126 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.554212 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.554433 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.554537 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.554782 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.554870 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.555092 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.555179 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.555409 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.555506 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.555716 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.555802 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.556022 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.556105 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.556326 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.556454 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.556635 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.556720 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.556941 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.557034 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.557253 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.557347 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.557557 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.557643 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.557873 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.557966 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.558177 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.558307 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.558485 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.558570 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.558807 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.558939 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.559116 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.559220 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.559448 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.559727 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.559851 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.560069 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.560202 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.560375 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.560520 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.560663 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.560770 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.560985 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.561135 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.561310 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.561445 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.561595 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.561844 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.561946 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.562031 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.562189 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.562283 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.562490 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.562590 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.562834 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.562928 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.563137 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.563228 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.563449 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.563556 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.563753 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.563844 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.564062 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.564154 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.564367 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.564466 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.564667 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.564759 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.564961 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.565051 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.565253 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.565358 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.565554 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.565647 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.565860 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.565959 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.566171 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.566271 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.566455 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.566595 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.566809 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.566895 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.567068 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.567165 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.567366 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.567461 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.567668 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.567754 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.567964 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.568051 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.568260 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.568396 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.568559 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.568647 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.568865 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.568998 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.569167 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.569262 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.569464 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.569552 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.569760 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.569849 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.570429 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.570524 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.570749 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.570853 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.571047 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.571143 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.571345 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.571433 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.571645 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.571745 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.571946 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.572034 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.572247 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.572333 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.572557 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.572658 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.572870 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.572957 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.573167 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.573253 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.573460 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.573560 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.573772 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.573860 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.574072 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.574159 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.574370 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.574516 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.574692 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.574847 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.575113 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.575285 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.575442 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.575630 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.575725 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.575935 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.576023 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.576233 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.576335 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.576545 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.576632 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.576860 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.576991 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.577165 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.577262 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.577476 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.577576 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.577779 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.577871 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.578079 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.578179 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.578385 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.578516 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.578709 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.578804 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.579019 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.579160 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.579333 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.579465 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.579775 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.579922 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.580087 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.580254 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.580392 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.580567 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.580704 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.580883 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.581069 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.581192 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.581302 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.581506 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.581600 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.581830 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.581926 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.582151 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.582276 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.582469 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.582555 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.582803 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.583059 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.583159 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.583388 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.583477 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.583688 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.583784 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.583997 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.584092 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.584294 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.584381 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.584598 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.584685 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.584895 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.584983 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.585199 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.585287 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.585498 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.585585 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.585803 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.585907 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.586103 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.586190 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.586403 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.586501 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.586718 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.586825 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587019 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587103 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587318 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587412 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587612 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587702 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587907 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.587983 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.588211 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.588287 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.588508 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.588593 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.588804 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.588880 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.589100 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.589179 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.589393 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.589471 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.589706 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.589782 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.590002 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.590078 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.590305 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.590436 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.590723 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.590836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.590999 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.591089 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.591300 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.591385 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.591597 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.591719 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.591894 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.591970 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.592189 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.592267 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.592517 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.592592 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.592811 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.592894 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.593112 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.593193 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.593413 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.593500 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.593721 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.593818 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.594013 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.594091 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.594318 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.594401 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.594623 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.594749 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.594952 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.595036 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.595245 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.595323 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.595540 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.595630 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.595837 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.595912 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.596137 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.596213 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.596432 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.596509 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.596726 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.596809 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597025 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597105 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597322 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597406 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597659 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597755 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597907 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.597990 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.598201 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.598278 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.598494 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.598568 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.598818 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.598899 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.599118 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.599195 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.599410 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.599485 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.599708 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.599793 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600009 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600085 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600306 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600387 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600598 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600685 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600899 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.600975 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.601193 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.601275 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.601488 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.601573 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.601782 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.601856 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.602075 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.602150 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.602370 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.602454 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.602685 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.602764 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.602985 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.603061 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.603279 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.603357 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.603587 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.603661 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.603887 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.603970 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.604183 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.604270 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.604477 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.604553 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.604775 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.604849 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.605068 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.605143 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.605361 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.605436 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.605660 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.605751 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.605956 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.606119 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.606307 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.606474 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.606598 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.606869 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.606994 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.607102 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.607229 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.607390 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.607529 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.607776 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.607900 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.608008 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.608111 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.608275 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.608437 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.608570 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.608737 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.608858 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.609092 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.609206 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.609394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.609518 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.609702 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.609814 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.610064 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.610186 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.610304 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.610410 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.610586 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.610738 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.610905 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.611038 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.611201 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.611316 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.611535 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.611657 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.611833 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.611945 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.612138 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.612251 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.612437 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.612558 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.612735 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.612856 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.613527 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.613616 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.613616 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.613750 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.613816 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.613959 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614048 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614115 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614181 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614266 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614492 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614582 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614815 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.614917 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.615120 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.615209 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.615434 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.615518 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.615712 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.615799 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.616023 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.616109 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.616324 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.616411 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.616618 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.616782 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.616983 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.617126 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.617249 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.617345 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.617514 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.617602 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.617825 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.617968 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.618108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.618205 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.618407 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.618493 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.618729 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.618841 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.619027 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.619113 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.619328 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.619424 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.619630 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.619733 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.619929 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.620016 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.620228 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.620326 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.620526 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.620621 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.620822 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.620909 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.621119 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.621212 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.621416 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.621559 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.621783 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.622047 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.622185 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.622365 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.622513 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.622691 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.622841 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.623007 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.623140 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.623317 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.623441 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.623630 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.623738 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.623957 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.624048 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.624248 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.624344 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.624662 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.624749 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625059 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625166 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625286 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625376 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625596 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625690 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625897 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.625992 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.626196 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.626283 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.626499 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.626585 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.626829 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.626919 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.627128 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.627228 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.627425 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.627533 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.627725 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.627835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.628044 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.628133 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.628348 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.628435 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.628668 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.628765 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.628990 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.629086 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.629298 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.629394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.629610 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.629706 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.629908 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.630048 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.630203 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.630359 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.630499 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.630665 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.630852 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.630989 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.631149 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.631309 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.631460 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.631631 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.631861 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.631949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.632162 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.632251 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.632457 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.632555 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.632830 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.632916 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.633150 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.633237 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.633448 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.633545 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.633757 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.633844 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.634057 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.634150 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.634367 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.634454 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.634793 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.634889 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.634971 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.635051 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.635274 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.635375 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.635588 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.635733 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.635902 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.636015 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.636205 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.636326 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.636509 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.636650 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.636804 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.636973 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.637118 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.637307 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.637526 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.637640 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.637948 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.638042 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.638250 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.638348 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.638555 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.638729 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.638900 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.639047 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.639204 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.639361 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.639512 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.639679 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.639819 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.639998 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.640123 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.640298 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.640424 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.640602 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.640724 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.640904 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.641044 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.641204 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.641345 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.641503 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.641665 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.641815 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.641975 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.642111 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.642294 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.642412 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.642612 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.642719 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.642936 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.643028 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.643254 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.643344 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.643560 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.643647 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.643877 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.643972 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.644163 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.644250 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.644461 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.644562 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.644767 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.644868 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.645080 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.645168 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.645393 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.645490 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.645693 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.645827 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.646005 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.646093 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.646306 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.646404 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.646603 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.646711 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.646922 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.647013 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.647217 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.647356 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.647551 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.647648 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.647849 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.647938 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.648163 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.648259 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.648461 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.648556 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.648768 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.648869 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.649068 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.649159 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.649369 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.649456 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.649669 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.649762 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.649973 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.650063 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.650271 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.650359 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.650571 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.650690 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.650895 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.650985 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.651196 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.651292 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.651498 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.651601 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.651795 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.651884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.652092 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.652179 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.652387 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.652489 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.652686 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.652782 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.653040 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.653138 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.653408 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.653505 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.653710 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.653806 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.654024 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.654113 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.654323 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.654419 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.654636 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.654745 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.655041 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.655129 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.655355 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.655444 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.655653 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.655740 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.655953 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.656048 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.656268 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.656356 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.656573 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.656667 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.656882 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.656969 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.657186 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.657274 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.657496 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.657583 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.657801 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.657887 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.658108 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.658198 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.658416 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.658706 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.658798 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.659043 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.659140 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.659353 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.659440 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.659660 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.659759 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.659963 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.660052 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.660269 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.660357 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.660580 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.660718 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.660891 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.660980 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.661200 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.661440 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.661529 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.661768 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.661866 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.662078 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.662168 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.662384 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.662471 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.662709 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.662851 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.663019 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.663108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.663325 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.663414 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.663631 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.663730 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.663935 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.664031 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.664241 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.664348 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.664544 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.664687 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.664858 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.665001 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.665174 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.665305 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.665489 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.665622 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.665817 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.665933 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.666129 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.666244 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.666438 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.666549 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.666765 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.666881 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.667072 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.667190 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.667422 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.667500 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.667730 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.667811 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.668028 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.668106 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.668339 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.668438 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.668762 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.668858 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.669220 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.669343 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.669750 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.669853 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.669926 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.670003 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.670237 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.670356 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.670547 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.670796 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.670903 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.671154 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.671241 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.671456 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.671764 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.671858 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.672076 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.672156 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.672400 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.672476 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.672713 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.672795 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.673024 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.673140 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.673326 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.673570 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.673649 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.673929 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.674146 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.674296 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.674459 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.674603 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.674810 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.674933 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.675131 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.675242 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.675450 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.675588 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.675762 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.675921 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.676078 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.676369 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.676479 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.676691 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.676767 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.676996 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.677084 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.677301 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.677393 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.677604 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.677692 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.677900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.678130 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.678222 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.678482 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.678576 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.678814 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.678918 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.679142 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.679293 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.679435 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.679578 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.679765 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.679949 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.680117 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.680293 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.680450 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.680594 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.680753 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.680977 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.681176 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.681330 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.681481 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.681633 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.681799 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.681950 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.682094 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.682238 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.682384 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.682534 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.682771 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.682919 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.683067 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.683214 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.683359 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.683525 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.683671 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.683815 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.683957 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.684101 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.684278 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.684442 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.684599 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.684745 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.684904 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.685050 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.685197 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.685197 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.685549 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.685713 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.685872 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.686023 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.686184 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.686326 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.686466 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.686611 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.686845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.686992 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.687153 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.687300 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.687446 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.687588 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.687731 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.687875 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.688041 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.688187 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.688330 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.688470 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.688614 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.688759 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.688920 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.689072 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.689216 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.689216 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.689471 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.689631 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.689782 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.689929 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.690086 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.690230 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.690379 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.690539 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.690708 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.690854 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691056 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691209 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691303 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691400 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691491 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691574 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691662 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691742 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691821 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.691910 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.692132 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.692256 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.692436 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.692593 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.692741 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.692912 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.693083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.693244 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.693395 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.693572 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.693878 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.693967 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.694184 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.694272 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.694487 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.694575 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.694833 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.694937 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.695503 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.695602 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.695812 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.695900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.696110 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.696197 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.696408 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.696497 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.696716 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.696811 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.697018 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.697105 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.697321 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.697409 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.697625 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.697722 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.697930 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.698018 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.698231 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.698318 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.698532 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.698628 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.698866 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.698955 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.699170 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.699258 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.699472 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.699569 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.699824 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.699929 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.700172 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.700406 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.700509 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.700794 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.700888 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.701108 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.701205 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.701415 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.701596 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.701726 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.701816 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.702062 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.702157 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.702378 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.702475 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.702706 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.702797 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.703021 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.703108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.703335 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.703425 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.703642 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.703738 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.703943 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.704030 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.704247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.704365 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.704553 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.704676 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.704865 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.704992 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.705189 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.705313 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.705498 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.705635 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.705797 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.705929 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.706212 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.706308 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.706523 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.706611 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.706860 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.706959 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.707178 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.707275 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.707484 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.707573 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.707802 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.707899 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.708123 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.708212 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.708429 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.708517 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.708735 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.708823 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.709035 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.709124 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.709338 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.709427 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.709645 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.709741 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.709960 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.710048 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.710267 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.710362 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.710569 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.710678 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.710891 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.710979 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.711189 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.711291 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.711488 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.711575 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.711789 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.711877 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.712089 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.712185 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.712386 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.712473 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.712681 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.712768 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.712978 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.713074 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.713272 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.713355 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.713569 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.713668 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.713866 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.713963 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.714162 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.714258 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.714458 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.714545 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.714779 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.714872 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.715077 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.715176 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.715399 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.715527 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.715703 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.715859 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.716000 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.716170 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.716297 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.716472 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.716650 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.716801 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.716891 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.717134 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.717222 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.717446 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.717585 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.717797 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.717885 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.718096 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.718183 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.718412 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.718508 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.718741 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.718882 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.719059 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.719146 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.719373 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.719464 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.719678 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.719767 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.719982 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.720070 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.720281 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.720378 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.720595 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.720687 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.720898 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.720985 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.721207 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.721334 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.721506 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.721595 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.721809 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.721906 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.722115 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.722217 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.722417 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.722505 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.722746 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.722857 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.723052 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.723140 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.723354 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.723451 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.723660 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.723756 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.723978 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.724066 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.724290 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.724379 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.724635 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.724732 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.724905 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.724993 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.725211 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.725300 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.725518 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.725610 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.725825 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.725912 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.726129 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.726226 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.726435 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.726525 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.726770 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.726861 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.727078 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.727178 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.727380 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.727470 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.727685 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.727774 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.727988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.728085 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.728295 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.728384 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.728597 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.728692 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.728906 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.729003 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.729215 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.729304 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.729524 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.729612 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.729843 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.729934 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.730162 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.730260 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.730467 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.730556 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.730814 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.730908 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.731232 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.731329 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.731577 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.731667 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.731901 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.731989 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.732146 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:23:36.732314 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.732636 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.732945 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.733253 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.733551 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:23:36.733790 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:23:36.888556 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO dbcounter [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Registered counter for database nova_api Aug 24 03:23:36.891691 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO dbcounter [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Registered counter for database nova_api Aug 24 03:23:36.910037 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:36.912145 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:36.917402 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writer thread running {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:36.919044 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writer thread running {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:36.975275 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.context [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97a45c54-1fe5-4470-83ef-9fef2d361903(cell1) {{(pid=105582) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:23:36.979108 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:36.979578 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:36.981297 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:36.982403 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:36.983057 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:36.983912 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.context [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97a45c54-1fe5-4470-83ef-9fef2d361903(cell1) {{(pid=105583) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:23:36.985071 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:36.987112 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO dbcounter [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Registered counter for database nova_cell0 Aug 24 03:23:36.988547 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_concurrency.lockutils [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:36.989133 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_concurrency.lockutils [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:36.991049 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_concurrency.lockutils [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:36.991973 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_concurrency.lockutils [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:36.992417 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_concurrency.lockutils [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:36.992805 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO dbcounter [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Registered counter for database nova_cell1 Aug 24 03:23:36.994793 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_concurrency.lockutils [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:36.997271 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO dbcounter [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Registered counter for database nova_cell0 Aug 24 03:23:37.001174 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:37.003158 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:37.004351 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO dbcounter [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Registered counter for database nova_cell1 Aug 24 03:23:37.010218 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writer thread running {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:37.011748 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writer thread running {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:37.012427 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:37.017269 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writer thread running {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:37.017945 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:37.156581 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO dbcounter [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Registered counter for database nova_cell0 Aug 24 03:23:37.161329 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writer thread running {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:37.166485 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:37.171391 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writer thread running {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:37.171592 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO dbcounter [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Registered counter for database nova_cell0 Aug 24 03:23:37.181924 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:23:37.188151 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writer thread running {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:23:37.513286 dv-cinder-854260-1-smb devstack@n-api.service[105582]: WARNING keystonemiddleware.auth_token [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:23:37.520692 dv-cinder-854260-1-smb devstack@n-api.service[105582]: WARNING keystonemiddleware.auth_token [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:23:37.525334 dv-cinder-854260-1-smb devstack@n-api.service[105583]: WARNING keystonemiddleware.auth_token [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:23:37.533363 dv-cinder-854260-1-smb devstack@n-api.service[105583]: WARNING keystonemiddleware.auth_token [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:23:37.871765 dv-cinder-854260-1-smb devstack@n-api.service[105582]: WARNING keystonemiddleware.auth_token [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:23:37.877649 dv-cinder-854260-1-smb devstack@n-api.service[105582]: WARNING keystonemiddleware.auth_token [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:23:37.882975 dv-cinder-854260-1-smb devstack@n-api.service[105582]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588a12cf9c0 pid: 105582 (default app) Aug 24 03:23:37.885077 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:37.886282 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001785 Aug 24 03:23:37.886706 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Wed Aug 24 03:23:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:37.890386 dv-cinder-854260-1-smb devstack@n-api.service[105583]: WARNING keystonemiddleware.auth_token [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:23:37.896322 dv-cinder-854260-1-smb devstack@n-api.service[105583]: WARNING keystonemiddleware.auth_token [None req-f0c52cda-1879-4d8d-97ea-a8aabbe2b7d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:23:37.901607 dv-cinder-854260-1-smb devstack@n-api.service[105583]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588a12cf9c0 pid: 105583 (default app) Aug 24 03:24:57.947489 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:57.948559 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 24 03:24:57.949216 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:57.961761 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writing DB stats nova_api:SELECT=3 {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:57.963107 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writing DB stats nova_cell0:SELECT=3 {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:57.964640 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writing DB stats nova_cell1:SELECT=3 {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:57.965938 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:58.879792 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-822ee867-ae8e-49a7-9540-a7904566ee06 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:58.914175 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-822ee867-ae8e-49a7-9540-a7904566ee06 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.957397 Aug 24 03:24:58.915175 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 24 03:24:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:01.306274 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:01.307453 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-ff9d1045-5f29-4aeb-b2a6-1987a2c14e87 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 03:25:01.314278 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:01.822058 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-9f6520c5-823e-46f1-b57d-b866226358dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "swap": 0, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:01.842105 dv-cinder-854260-1-smb devstack@n-api.service[105583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:25:01.842105 dv-cinder-854260-1-smb devstack@n-api.service[105583]: warnings.warn(msg) Aug 24 03:25:01.870436 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-9f6520c5-823e-46f1-b57d-b866226358dc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.554866 Aug 24 03:25:01.871102 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:01.885868 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_api:SELECT=3 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:01.886699 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_cell1:SELECT=3 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:01.887777 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_cell0:SELECT=3 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:01.888801 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:02.095082 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-a62e7a74-3dc0-4344-85cb-485ff2a3659f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:02.099762 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:25:02.099762 dv-cinder-854260-1-smb devstack@n-api.service[105582]: warnings.warn(msg) Aug 24 03:25:02.167734 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-a62e7a74-3dc0-4344-85cb-485ff2a3659f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287516 Aug 24 03:25:02.168102 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 24 03:25:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:25:04.618578 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-9f6520c5-823e-46f1-b57d-b866226358dc admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:04.619646 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-9f6520c5-823e-46f1-b57d-b866226358dc admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 24 03:25:04.620078 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:05.322235 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-dd9f54d5-db4e-4ae7-a3ed-ebda67f94478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:05.341873 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:25:05.341873 dv-cinder-854260-1-smb devstack@n-api.service[105582]: warnings.warn(msg) Aug 24 03:25:05.366753 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-dd9f54d5-db4e-4ae7-a3ed-ebda67f94478 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.739707 Aug 24 03:25:05.367822 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:25:05.381322 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-1e761a1d-b055-45c0-b0a0-00d6bd35fa30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:05.384604 dv-cinder-854260-1-smb devstack@n-api.service[105583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:25:05.384604 dv-cinder-854260-1-smb devstack@n-api.service[105583]: warnings.warn(msg) Aug 24 03:25:05.421945 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-1e761a1d-b055-45c0-b0a0-00d6bd35fa30 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044865 Aug 24 03:25:05.422685 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 24 03:25:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:07.819902 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-dd9f54d5-db4e-4ae7-a3ed-ebda67f94478 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:07.820846 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-dd9f54d5-db4e-4ae7-a3ed-ebda67f94478 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Aug 24 03:25:07.821248 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:08.288663 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-3bd401ce-8336-414f-9cb9-1783ea9f986c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:08.308621 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-3bd401ce-8336-414f-9cb9-1783ea9f986c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480966 Aug 24 03:25:08.309569 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:08.322163 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-a397b288-5792-4d91-a4b6-d582b49775d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:08.347849 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-a397b288-5792-4d91-a4b6-d582b49775d0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029737 Aug 24 03:25:08.348643 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 24 03:25:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:10.821925 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-3bd401ce-8336-414f-9cb9-1783ea9f986c admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:10.823600 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-3bd401ce-8336-414f-9cb9-1783ea9f986c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002368 Aug 24 03:25:10.824204 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:11.342744 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-b1c22e98-0070-4365-afa5-73e521e602e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "name": "ds2G"}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:11.370641 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-b1c22e98-0070-4365-afa5-73e521e602e8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.539069 Aug 24 03:25:11.371618 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:11.383805 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-007477c4-d3f9-474e-8d58-bf9b0f6a9800 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:11.410534 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-007477c4-d3f9-474e-8d58-bf9b0f6a9800 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030483 Aug 24 03:25:11.411175 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 24 03:25:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:13.808834 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-b1c22e98-0070-4365-afa5-73e521e602e8 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:13.809741 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-b1c22e98-0070-4365-afa5-73e521e602e8 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001804 Aug 24 03:25:13.810623 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:14.267212 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-beae1180-fbe3-489e-a932-607465fa053f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:14.288567 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-beae1180-fbe3-489e-a932-607465fa053f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471580 Aug 24 03:25:14.289118 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:14.302178 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-0e116bdf-9290-4b94-a185-10eca5a31057 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:14.332298 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-0e116bdf-9290-4b94-a185-10eca5a31057 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034441 Aug 24 03:25:14.344746 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Wed Aug 24 03:25:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:17.075314 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-beae1180-fbe3-489e-a932-607465fa053f admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.076576 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-beae1180-fbe3-489e-a932-607465fa053f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001858 Aug 24 03:25:17.077057 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:17.579109 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-c76a423b-0864-4023-a6ef-1dde94e54ad6 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.606935 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-c76a423b-0864-4023-a6ef-1dde94e54ad6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.523108 Aug 24 03:25:17.607906 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:25:20.749641 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-beae1180-fbe3-489e-a932-607465fa053f admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:20.750591 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-beae1180-fbe3-489e-a932-607465fa053f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 24 03:25:20.751037 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:21.236703 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-9fdd9663-16fe-47e3-8965-61872dbe5e72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:21.259601 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-9fdd9663-16fe-47e3-8965-61872dbe5e72 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.501890 Aug 24 03:25:21.260257 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:21.273313 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-7166336b-dca2-4133-bc7f-9284eb2c062a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:21.305086 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-7166336b-dca2-4133-bc7f-9284eb2c062a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035537 Aug 24 03:25:21.305803 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 24 03:25:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:23.739360 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-9fdd9663-16fe-47e3-8965-61872dbe5e72 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:23.740543 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-9fdd9663-16fe-47e3-8965-61872dbe5e72 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Aug 24 03:25:23.740981 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:24.203083 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-5abc47c1-0243-4069-908b-ef3622040dce admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "swap": 0}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:24.224505 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-5abc47c1-0243-4069-908b-ef3622040dce admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476776 Aug 24 03:25:24.225179 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:24.239836 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-afe2121c-5b5e-42b8-b7aa-1fd28c3e8b61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:24.268505 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-afe2121c-5b5e-42b8-b7aa-1fd28c3e8b61 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032412 Aug 24 03:25:24.269239 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 24 03:25:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:26.917006 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-5abc47c1-0243-4069-908b-ef3622040dce admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:26.918023 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-5abc47c1-0243-4069-908b-ef3622040dce admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Aug 24 03:25:26.918428 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:27.418965 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-911d5ccf-db09-412c-9fb0-5687cea8c1d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "id": "3"}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:27.440483 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-911d5ccf-db09-412c-9fb0-5687cea8c1d3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.515575 Aug 24 03:25:27.446689 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:27.454375 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-8aebdbf3-eeaf-43ec-8bbd-3479fc6eb496 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:27.483982 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-8aebdbf3-eeaf-43ec-8bbd-3479fc6eb496 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032758 Aug 24 03:25:27.484640 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 24 03:25:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:29.924814 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-911d5ccf-db09-412c-9fb0-5687cea8c1d3 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:29.926449 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-911d5ccf-db09-412c-9fb0-5687cea8c1d3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Aug 24 03:25:29.927208 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:30.456975 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-1a84202a-ffd9-4e2e-b7f1-b2ae65ee1508 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:30.467120 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.482997 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-1a84202a-ffd9-4e2e-b7f1-b2ae65ee1508 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.548985 Aug 24 03:25:30.483626 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:30.496224 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-351be8f0-4fb5-465d-867c-e61cbe01ba32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:30.521905 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-351be8f0-4fb5-465d-867c-e61cbe01ba32 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029488 Aug 24 03:25:30.522489 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 24 03:25:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:33.009909 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-1a84202a-ffd9-4e2e-b7f1-b2ae65ee1508 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:33.011107 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-1a84202a-ffd9-4e2e-b7f1-b2ae65ee1508 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Aug 24 03:25:33.011979 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:33.462757 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-27188cb6-fc4b-47b6-9213-e8119f412660 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:33.470884 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:33.489786 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-27188cb6-fc4b-47b6-9213-e8119f412660 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471177 Aug 24 03:25:33.490695 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Wed Aug 24 03:25:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:33.505055 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-7a8da058-fea2-4b1d-b386-a497923e8747 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:33.537398 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-7a8da058-fea2-4b1d-b386-a497923e8747 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037427 Aug 24 03:25:33.550782 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Wed Aug 24 03:25:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:50.833431 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-27188cb6-fc4b-47b6-9213-e8119f412660 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:50.834796 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-27188cb6-fc4b-47b6-9213-e8119f412660 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Aug 24 03:25:50.835417 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:50.853577 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.297463 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-80ea1310-36c0-453b-b81b-032613ab4191 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:51.319103 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-80ea1310-36c0-453b-b81b-032613ab4191 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.472359 Aug 24 03:25:51.319656 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 24 03:25:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:25:52.418711 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-27188cb6-fc4b-47b6-9213-e8119f412660 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:52.419738 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-27188cb6-fc4b-47b6-9213-e8119f412660 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 03:25:52.420118 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:52.989950 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-c95c53d3-469c-496a-816b-81529471193e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:52.999058 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.wsgi [None req-c95c53d3-469c-496a-816b-81529471193e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-c95c53d3-469c-496a-816b-81529471193e admin admin] Request method failure captured: Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Accept: application/json Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Accept-Encoding: gzip, deflate Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Connection: keep-alive Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Content-Length: 0 Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Host: 10.222.0.78 Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Openstack-Api-Version: compute 2.90 Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Openstack-System-Scope: None Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: User-Agent: python-novaclient Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Auth-Token: gAAAAABjBZpAk38BVS4IvyD8SLBkrrP52Me2HJBn0XpJyAIqOhkZdKiRtZG-lQqen9UPHXqBll3KRhP3oWdLBZt9ZEM7CjIMQ2qBTgF_bQ5XM1SEuWalJTHEx5YM7hoIKD76CHx_0pl3mDkegeeioTTcjhqATOz1n5U6UR5zTo3gdnqE3jRqzb4 Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Domain-Id: None Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Domain-Name: None Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Identity-Status: Confirmed Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Is-Admin-Project: True Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Domain-Id: default Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Domain-Name: Default Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Name: admin Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Role: reader,member,admin Aug 24 03:25:53.004449 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Roles: reader,member,admin Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7911c9363a5f49a3b74eb85a8f08a450"}]}] Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant: admin Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant-Name: admin Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User: admin Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Domain-Id: default Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Domain-Name: Default Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Id: 4cd618c84674445b8b18062be3eac4f8 Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Name: admin Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: method: > Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: exception: Flavor 42 could not be found. Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: action_args: {'id': '42'} Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:25:53.006108 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:53.007191 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.008653 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-c95c53d3-469c-496a-816b-81529471193e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:25:53.010089 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-c95c53d3-469c-496a-816b-81529471193e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.447343 Aug 24 03:25:53.010089 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 24 03:25:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:25:53.016050 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-4b2c160f-0c13-4154-ab7a-cf114ad56077 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:53.039133 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-4b2c160f-0c13-4154-ab7a-cf114ad56077 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026678 Aug 24 03:25:53.039745 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 24 03:25:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:25:53.049872 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-5215dbf0-d9e3-44b9-a1b0-459c3b7bf486 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:53.075850 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-5215dbf0-d9e3-44b9-a1b0-459c3b7bf486 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029570 Aug 24 03:25:53.076419 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 24 03:25:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:25:53.086428 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-c3ec6625-1733-430f-9c14-fc09cdca6229 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:53.093185 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.wsgi [None req-c3ec6625-1733-430f-9c14-fc09cdca6229 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-c3ec6625-1733-430f-9c14-fc09cdca6229 admin admin] Request method failure captured: Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Accept: application/json Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Accept-Encoding: gzip, deflate Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Connection: keep-alive Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Content-Length: 0 Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Host: 10.222.0.78 Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Openstack-Api-Version: compute 2.90 Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Openstack-System-Scope: None Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: User-Agent: python-novaclient Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Auth-Token: gAAAAABjBZpAk38BVS4IvyD8SLBkrrP52Me2HJBn0XpJyAIqOhkZdKiRtZG-lQqen9UPHXqBll3KRhP3oWdLBZt9ZEM7CjIMQ2qBTgF_bQ5XM1SEuWalJTHEx5YM7hoIKD76CHx_0pl3mDkegeeioTTcjhqATOz1n5U6UR5zTo3gdnqE3jRqzb4 Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Domain-Id: None Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Domain-Name: None Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Identity-Status: Confirmed Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Is-Admin-Project: True Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Domain-Id: default Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Domain-Name: Default Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Name: admin Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Role: reader,member,admin Aug 24 03:25:53.096517 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Roles: reader,member,admin Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7911c9363a5f49a3b74eb85a8f08a450"}]}] Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant: admin Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant-Name: admin Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User: admin Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Domain-Id: default Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Domain-Name: Default Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Id: 4cd618c84674445b8b18062be3eac4f8 Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Name: admin Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: method: > Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: exception: Flavor 42 could not be found. Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: action_args: {'id': '42'} Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:25:53.097900 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:53.098683 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:53.099845 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-c3ec6625-1733-430f-9c14-fc09cdca6229 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:25:53.100959 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-c3ec6625-1733-430f-9c14-fc09cdca6229 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015191 Aug 24 03:25:53.100959 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 24 03:25:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:54.117590 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-5215dbf0-d9e3-44b9-a1b0-459c3b7bf486 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:54.118691 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-5215dbf0-d9e3-44b9-a1b0-459c3b7bf486 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 03:25:54.119098 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:54.704327 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-d6d57cd3-6b2c-4874-98af-99c4135a4864 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:54.709973 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.wsgi [None req-d6d57cd3-6b2c-4874-98af-99c4135a4864 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-d6d57cd3-6b2c-4874-98af-99c4135a4864 admin admin] Request method failure captured: Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Accept: application/json Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Accept-Encoding: gzip, deflate Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Connection: keep-alive Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Content-Length: 0 Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Host: 10.222.0.78 Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Openstack-Api-Version: compute 2.90 Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Openstack-System-Scope: None Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: User-Agent: python-novaclient Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Auth-Token: gAAAAABjBZpBFDRthcM1QDKGWUmaXqmt9JZIqUSWfTbmE5EUlnHasvva-gkFm59etvZ8Er_1nGDaf6IYEtUZFklwJd6jx7pLsfANXobZKW3F0F6KRYZsDiO_Rk7s3t_j7Nxr6caWK1QmHsnTL9G1R1sr7LuSvK2xkuO9BaxjGTuslcGtJP9fLBU Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Domain-Id: None Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Domain-Name: None Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Identity-Status: Confirmed Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Is-Admin-Project: True Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Domain-Id: default Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Domain-Name: Default Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Name: admin Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Role: reader,member,admin Aug 24 03:25:54.711515 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Roles: reader,member,admin Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7911c9363a5f49a3b74eb85a8f08a450"}]}] Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant: admin Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant-Name: admin Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User: admin Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Domain-Id: default Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Domain-Name: Default Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Id: 4cd618c84674445b8b18062be3eac4f8 Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Name: admin Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: method: > Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: exception: Flavor 84 could not be found. Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: action_args: {'id': '84'} Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:25:54.713056 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:54.713835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.714988 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-d6d57cd3-6b2c-4874-98af-99c4135a4864 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:25:54.716230 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-d6d57cd3-6b2c-4874-98af-99c4135a4864 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.457098 Aug 24 03:25:54.716230 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 24 03:25:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 459 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:25:54.727206 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-288c3988-e815-4307-9fef-a56fe67693e7 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:54.743126 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-288c3988-e815-4307-9fef-a56fe67693e7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021564 Aug 24 03:25:54.743926 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 24 03:25:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:25:54.753644 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-79686acd-ec11-45dd-bca5-837682b06efd admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:54.769532 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-79686acd-ec11-45dd-bca5-837682b06efd admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019505 Aug 24 03:25:54.770079 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 24 03:25:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:25:54.782556 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-cad76619-a2d9-4a3e-84e0-c185fe94cd54 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:54.791313 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.wsgi [None req-cad76619-a2d9-4a3e-84e0-c185fe94cd54 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-cad76619-a2d9-4a3e-84e0-c185fe94cd54 admin admin] Request method failure captured: Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Accept: application/json Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Accept-Encoding: gzip, deflate Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Connection: keep-alive Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Content-Length: 0 Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Host: 10.222.0.78 Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Openstack-Api-Version: compute 2.90 Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Openstack-System-Scope: None Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: User-Agent: python-novaclient Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Auth-Token: gAAAAABjBZpBFDRthcM1QDKGWUmaXqmt9JZIqUSWfTbmE5EUlnHasvva-gkFm59etvZ8Er_1nGDaf6IYEtUZFklwJd6jx7pLsfANXobZKW3F0F6KRYZsDiO_Rk7s3t_j7Nxr6caWK1QmHsnTL9G1R1sr7LuSvK2xkuO9BaxjGTuslcGtJP9fLBU Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Domain-Id: None Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Domain-Name: None Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Identity-Status: Confirmed Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Is-Admin-Project: True Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Domain-Id: default Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Domain-Name: Default Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Name: admin Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Role: reader,member,admin Aug 24 03:25:54.792836 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Roles: reader,member,admin Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7911c9363a5f49a3b74eb85a8f08a450"}]}] Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant: admin Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant-Name: admin Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User: admin Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Domain-Id: default Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Domain-Name: Default Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Id: 4cd618c84674445b8b18062be3eac4f8 Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Name: admin Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: method: > Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: exception: Flavor 84 could not be found. Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: action_args: {'id': '84'} Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:25:54.794236 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:54.795144 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:54.796777 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-cad76619-a2d9-4a3e-84e0-c185fe94cd54 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:25:54.798182 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-cad76619-a2d9-4a3e-84e0-c185fe94cd54 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017718 Aug 24 03:25:54.798182 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Aug 24 03:25:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:55.796423 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-79686acd-ec11-45dd-bca5-837682b06efd admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:55.798019 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-79686acd-ec11-45dd-bca5-837682b06efd admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Aug 24 03:25:55.798709 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:25:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:56.372386 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-44027ae2-fa48-4492-81a7-f6c39b1ad2d4 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:56.378867 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.wsgi [None req-44027ae2-fa48-4492-81a7-f6c39b1ad2d4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-44027ae2-fa48-4492-81a7-f6c39b1ad2d4 admin admin] Request method failure captured: Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Accept: application/json Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Accept-Encoding: gzip, deflate Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Connection: keep-alive Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Content-Length: 0 Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Host: 10.222.0.78 Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Openstack-Api-Version: compute 2.90 Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Openstack-System-Scope: None Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: User-Agent: python-novaclient Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Auth-Token: gAAAAABjBZpDspnmxBR4ruqOC5eLdJwaxA0KZqGHbnj7YqhfPUd_t252ufYfzey6E4108An1SopDTvDZz1GyNDlAhNR3J2WG5FlNmzqiarj9Bct6kGxeP3VVaq_QLyE-kWQ2Ek5_QIavDa5oPP5nqa5EF4E-azzvA8OxHT7Xxl6v3325hLhzFlY Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Domain-Id: None Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Domain-Name: None Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Identity-Status: Confirmed Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Is-Admin-Project: True Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Domain-Id: default Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Domain-Name: Default Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Project-Name: admin Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Role: reader,member,admin Aug 24 03:25:56.380394 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Roles: reader,member,admin Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7911c9363a5f49a3b74eb85a8f08a450"}]}] Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant: admin Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-Tenant-Name: admin Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User: admin Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Domain-Id: default Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Domain-Name: Default Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Id: 4cd618c84674445b8b18062be3eac4f8 Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: X-User-Name: admin Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: method: > Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: exception: Flavor 451 could not be found. Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: action_args: {'id': '451'} Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:25:56.381884 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:56.382905 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.383949 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-44027ae2-fa48-4492-81a7-f6c39b1ad2d4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:25:56.384957 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-44027ae2-fa48-4492-81a7-f6c39b1ad2d4 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.443594 Aug 24 03:25:56.384957 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 24 03:25:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:56.392524 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-910521a4-bb32-4ffd-ae53-d3835e3dc96d admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:56.408265 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-910521a4-bb32-4ffd-ae53-d3835e3dc96d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019282 Aug 24 03:25:56.408824 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 24 03:25:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:25:56.419063 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:56.434646 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019444 Aug 24 03:25:56.435254 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Aug 24 03:25:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:25:56.447922 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-0da5d501-2cb6-4e4a-9330-127cc8f990f7 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:56.456694 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.wsgi [None req-0da5d501-2cb6-4e4a-9330-127cc8f990f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-0da5d501-2cb6-4e4a-9330-127cc8f990f7 admin admin] Request method failure captured: Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Accept: application/json Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Accept-Encoding: gzip, deflate Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Connection: keep-alive Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Content-Length: 0 Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Host: 10.222.0.78 Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Openstack-Api-Version: compute 2.90 Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Openstack-System-Scope: None Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: User-Agent: python-novaclient Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Auth-Token: gAAAAABjBZpDspnmxBR4ruqOC5eLdJwaxA0KZqGHbnj7YqhfPUd_t252ufYfzey6E4108An1SopDTvDZz1GyNDlAhNR3J2WG5FlNmzqiarj9Bct6kGxeP3VVaq_QLyE-kWQ2Ek5_QIavDa5oPP5nqa5EF4E-azzvA8OxHT7Xxl6v3325hLhzFlY Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Domain-Id: None Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Domain-Name: None Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Identity-Status: Confirmed Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Is-Admin-Project: True Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Domain-Id: default Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Domain-Name: Default Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Project-Name: admin Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Role: reader,member,admin Aug 24 03:25:56.458819 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Roles: reader,member,admin Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7911c9363a5f49a3b74eb85a8f08a450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7911c9363a5f49a3b74eb85a8f08a450"}]}] Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant: admin Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant-Id: 7911c9363a5f49a3b74eb85a8f08a450 Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-Tenant-Name: admin Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User: admin Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Domain-Id: default Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Domain-Name: Default Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Id: 4cd618c84674445b8b18062be3eac4f8 Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: X-User-Name: admin Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: method: > Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: exception: Flavor 451 could not be found. Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: action_args: {'id': '451'} Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:25:56.460247 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:56.462083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: ERROR nova.api.openstack.wsgi Aug 24 03:25:56.463167 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-0da5d501-2cb6-4e4a-9330-127cc8f990f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:25:56.464350 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-0da5d501-2cb6-4e4a-9330-127cc8f990f7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018169 Aug 24 03:25:56.464350 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 24 03:25:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:57.458465 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:57.459528 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 24 03:25:57.459925 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:58.052083 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-12cfc829-db83-4df5-a9a8-24da2356f947 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:58.074123 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-12cfc829-db83-4df5-a9a8-24da2356f947 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.476072 Aug 24 03:25:58.074703 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 24 03:25:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:25:59.075715 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:59.076879 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 24 03:25:59.077286 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:59.642120 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-a1c09698-a762-42ad-ba0f-f362a2d0e76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:59.663041 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-a1c09698-a762-42ad-ba0f-f362a2d0e76b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.443346 Aug 24 03:25:59.663630 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 24 03:25:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:26:00.676374 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:00.677397 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 03:26:00.677799 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:26:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:26:01.275524 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-e5f2ee0e-88e3-48aa-b128-038834628f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:26:01.299511 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-e5f2ee0e-88e3-48aa-b128-038834628f2c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.483295 Aug 24 03:26:01.300073 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 24 03:26:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:26:02.335087 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:02.336103 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 24 03:26:02.336503 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:26:03.087748 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-12b22cfd-9265-4fd5-9af2-6280be25ac9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:26:03.110152 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-12b22cfd-9265-4fd5-9af2-6280be25ac9b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.635373 Aug 24 03:26:03.110741 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Aug 24 03:26:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:26:04.107700 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:04.108713 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 03:26:04.109138 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:26:04.687764 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-adb1f542-e2c5-4a30-84c7-485d14f2e26d admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:04.709471 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-adb1f542-e2c5-4a30-84c7-485d14f2e26d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.459827 Aug 24 03:26:04.710016 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Wed Aug 24 03:26:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:26:59.644404 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:59.645345 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-696131ed-ad86-427b-a87c-952a63f1cb8e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 24 03:26:59.645781 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Wed Aug 24 03:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:26:59.656920 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.091461 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-3c2d1622-cebd-49b3-98cb-98a1ff4f669d admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:00.112158 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-3c2d1622-cebd-49b3-98cb-98a1ff4f669d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.459848 Aug 24 03:27:00.112748 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Wed Aug 24 03:26:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:27:00.134980 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG dbcounter [-] [105583] Writing DB stats nova_api:SELECT=14 {{(pid=105583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.140911 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-208f96c5-386b-48fd-9e1e-fdc25dd55fcb admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:00.152700 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-208f96c5-386b-48fd-9e1e-fdc25dd55fcb admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020024 Aug 24 03:27:00.153400 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Wed Aug 24 03:27:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:00.166364 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-a16ea216-abc5-4a8b-af80-2785af1d4fff admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:00.175139 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-a16ea216-abc5-4a8b-af80-2785af1d4fff admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012330 Aug 24 03:27:00.175581 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Wed Aug 24 03:27:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:00.188718 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:00.197497 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013133 Aug 24 03:27:00.198019 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Wed Aug 24 03:27:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:00.209835 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-7bc04560-440c-4fac-91dd-ab587f0fd224 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:00.217920 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-7bc04560-440c-4fac-91dd-ab587f0fd224 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011706 Aug 24 03:27:00.218450 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Wed Aug 24 03:27:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:15.030017 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.031714 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002548 Aug 24 03:30:15.032313 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:30:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:15.181513 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_api:SELECT=6 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:15.374968 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.377447 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:15.377447 dv-cinder-854260-1-smb devstack@n-api.service[105582]: warnings.warn(msg) Aug 24 03:30:15.378742 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.379228 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.379618 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.380354 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.380798 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.381189 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.420206 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-7cbf02bd-ef87-4e15-9df6-01fbb01f635b admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.240089 Aug 24 03:30:15.420803 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 24 03:30:15 2022] GET /compute/v2.1/os-services => generated 785 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:16.340057 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.341848 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002457 Aug 24 03:30:16.342515 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.550860 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.554881 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.554881 dv-cinder-854260-1-smb devstack@n-api.service[105582]: warnings.warn(msg) Aug 24 03:30:16.556182 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.556729 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.557188 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.558093 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.558947 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.559380 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.581908 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-ad1a218e-4274-4fcd-bb00-6699b1100449 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.096034 Aug 24 03:30:16.582513 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 24 03:30:16 2022] GET /compute/v2.1/os-services => generated 785 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:28.130091 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:28.131321 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Aug 24 03:30:28.132033 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:30:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:28.280353 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_cell0:SELECT=4 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:28.281645 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_cell1:SELECT=4 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:28.283126 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG dbcounter [-] [105582] Writing DB stats nova_api:SELECT=8 {{(pid=105582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:28.371827 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:28.374369 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:28.374369 dv-cinder-854260-1-smb devstack@n-api.service[105582]: warnings.warn(msg) Aug 24 03:30:28.377091 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.377565 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.377997 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.378754 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.379298 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.379704 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.408646 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-a075a704-2ff1-4db8-87cc-27b0fcc7f283 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.129229 Aug 24 03:30:28.410690 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 24 03:30:28 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:29.311791 dv-cinder-854260-1-smb devstack@n-api.service[105583]: DEBUG nova.api.openstack.wsgi [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] Calling method '>' {{(pid=105583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:29.313678 dv-cinder-854260-1-smb devstack@n-api.service[105583]: INFO nova.api.openstack.requestlog [None req-4a06da6f-35f5-499b-9459-8569441842e6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002624 Aug 24 03:30:29.314431 dv-cinder-854260-1-smb devstack@n-api.service[105583]: [pid: 105583|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Aug 24 03:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:29.536518 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG nova.api.openstack.wsgi [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] Calling method '>' {{(pid=105582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:29.539153 dv-cinder-854260-1-smb devstack@n-api.service[105582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:29.539153 dv-cinder-854260-1-smb devstack@n-api.service[105582]: warnings.warn(msg) Aug 24 03:30:29.540407 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.540879 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.541298 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.542028 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.542610 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.543071 dv-cinder-854260-1-smb devstack@n-api.service[105582]: DEBUG oslo_concurrency.lockutils [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.566409 dv-cinder-854260-1-smb devstack@n-api.service[105582]: INFO nova.api.openstack.requestlog [None req-8a79dfc2-9a3a-4958-bb9c-24d24930a1b5 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.108516 Aug 24 03:30:29.567038 dv-cinder-854260-1-smb devstack@n-api.service[105582]: [pid: 105582|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Aug 24 03:30:29 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:42.573316 dv-cinder-854260-1-smb systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 03:31:42.574286 dv-cinder-854260-1-smb devstack@n-api.service[105570]: Wed Aug 24 03:31:42 2022 - graceful shutdown triggered... Aug 24 03:31:42.575110 dv-cinder-854260-1-smb devstack@n-api.service[105582]: Gracefully killing worker 1 (pid: 105582)... Aug 24 03:31:42.575709 dv-cinder-854260-1-smb devstack@n-api.service[105583]: Gracefully killing worker 2 (pid: 105583)... Aug 24 03:31:43.575133 dv-cinder-854260-1-smb devstack@n-api.service[105570]: worker 1 buried after 1 seconds Aug 24 03:31:43.575133 dv-cinder-854260-1-smb devstack@n-api.service[105570]: worker 2 buried after 1 seconds Aug 24 03:31:43.575133 dv-cinder-854260-1-smb devstack@n-api.service[105570]: goodbye to uWSGI. Aug 24 03:31:43.577188 dv-cinder-854260-1-smb systemd[1]: devstack@n-api.service: Succeeded. Aug 24 03:31:43.578013 dv-cinder-854260-1-smb systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 03:31:43.582311 dv-cinder-854260-1-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:31:43.606399 dv-cinder-854260-1-smb devstack@n-api.service[127240]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:31:43 2022] *** Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: nodename: dv-cinder-854260-1-smb Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: machine: x86_64 Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: clock source: unix Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: pcre jit disabled Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: detected number of CPU cores: 4 Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: current working directory: / Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: your processes number limit is 47680 Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: your memory page size is 4096 bytes Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: detected max file descriptor number: 2048 Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: lock engine: pthread robust mutexes Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: thunder lock: enabled Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:31:43.613243 dv-cinder-854260-1-smb devstack@n-api.service[127240]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:31:43.655292 dv-cinder-854260-1-smb devstack@n-api.service[127240]: Python main interpreter initialized at 0x561b3c30f9c0 Aug 24 03:31:43.655292 dv-cinder-854260-1-smb devstack@n-api.service[127240]: python threads support enabled Aug 24 03:31:43.655292 dv-cinder-854260-1-smb devstack@n-api.service[127240]: your server socket listen backlog is limited to 100 connections Aug 24 03:31:43.655292 dv-cinder-854260-1-smb devstack@n-api.service[127240]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:31:43.655960 dv-cinder-854260-1-smb devstack@n-api.service[127240]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:31:43.655960 dv-cinder-854260-1-smb devstack@n-api.service[127240]: *** Operational MODE: preforking *** Aug 24 03:31:43.656162 dv-cinder-854260-1-smb devstack@n-api.service[127240]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:31:43.656162 dv-cinder-854260-1-smb devstack@n-api.service[127240]: spawned uWSGI master process (pid: 127240) Aug 24 03:31:43.656314 dv-cinder-854260-1-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:31:43.657232 dv-cinder-854260-1-smb devstack@n-api.service[127240]: spawned uWSGI worker 1 (pid: 127257, cores: 1) Aug 24 03:31:43.659449 dv-cinder-854260-1-smb devstack@n-api.service[127240]: spawned uWSGI worker 2 (pid: 127258, cores: 1) Aug 24 03:31:43.659449 dv-cinder-854260-1-smb devstack@n-api.service[127240]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:31:44.394628 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:31:44.598972 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:31:45.908103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:31:45.908103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: from cryptography.utils import int_from_bytes Aug 24 03:31:45.909330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:31:45.909330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: from cryptography.utils import int_from_bytes Aug 24 03:31:46.023578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:31:46.023578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: from cryptography.utils import int_from_bytes Aug 24 03:31:46.024516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:31:46.024516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: from cryptography.utils import int_from_bytes Aug 24 03:31:48.572019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:31:48.573006 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:31:48.573006 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:31:48.573365 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:31:48.573538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:31:48.573999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.574187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.574485 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.574805 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.575302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.575711 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.576070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.576443 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.576781 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.577048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.577372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.577672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-smb {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.578069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.578359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.578686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.579088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.579413 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.579754 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.580063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.580597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.582563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.582563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.582563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.582563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.584175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.584175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.584175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.584175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.584175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.586076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.586076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-smb {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.586076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.586076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.586076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.586076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.588530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.596300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.600982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.600982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.600982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.600982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.600982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.600982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.600982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.606130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.608048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.609842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:31:48.609842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:31:48.618361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.618361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.618969 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:31:48.622243 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.623845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:31:48.623845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:31:48.624371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.624371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.624883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.625120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.625362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.625596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.625841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.625841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.625841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.625841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.629473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.629863 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.630120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.630371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.630602 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.630880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.631110 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.631359 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.631600 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.631822 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.632065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.632303 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854260-1-smb {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.632541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.632796 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.633042 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.633469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.633722 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.635250 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.635551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.635822 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.636072 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.636377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.636631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.636906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.637164 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.637636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.637874 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.637874 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.639042 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.639375 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.639664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.641088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.641376 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.641594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.641798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.642009 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.642286 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.642512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.642787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.643053 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.643290 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.643536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.643785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.644022 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.644255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.644509 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.644943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.645560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.645803 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.646034 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.646393 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854260-1-smb {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.646638 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.646918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.647157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.647388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.647671 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.647892 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.648091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.648091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.648917 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.649562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.649823 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.650073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.650321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.650579 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.650904 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.651455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.651733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.651978 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.652212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.652448 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.652756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.653063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.653304 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.653531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.653764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.653998 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.654233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.654496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.654758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.655222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.655838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.656094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.656319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.656637 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.656957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.657189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.657416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.657639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.657878 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.658122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.658365 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.658594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.659168 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.659724 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.659992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.660236 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.660498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.660760 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.661011 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.661011 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.661842 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.662070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.662306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.662567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.663016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.663264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.663497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.663721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.664234 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.664554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.664804 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.665058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.665512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.665512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.666344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.666683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.666944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.666944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.667432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.667667 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.667932 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.668179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.668438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.668674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.668914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.669806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.670090 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.670334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.670607 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.670914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.671169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.671811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.672058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.672058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.672506 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.672506 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.673287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.673528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.673756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.673756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.674299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.674473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.674708 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.674708 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.675025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.675221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.675738 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.675738 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.676339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.676339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.676642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.676870 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.677035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.677220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.677413 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.677594 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.677751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.678020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.678186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.678334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.678503 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.678698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.678874 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.679061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.679241 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.679421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.679584 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.679758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.679985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.680166 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.680319 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.680471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.680633 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.680800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.680975 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.681141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.681300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.681469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.681662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.681843 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.681843 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.682303 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.682482 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.682686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.682884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.683047 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.683310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.683460 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.683601 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.683727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.683849 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.683971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.684112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.684243 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.684389 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.684527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.684669 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.684828 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.684974 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.685125 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.685271 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.685416 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.685553 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.685748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.685903 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.686073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.686239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.686387 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.686541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.686947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.687099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.687265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.687265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.687554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.687701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.687860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.687860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.688195 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.688379 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.688895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.689089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.689260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.689437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.689698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.689861 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.690051 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.690197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.690397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.690587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.690587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.691142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.691317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.691497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.691665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.691822 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.691983 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.692143 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.692301 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.692456 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.692608 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.692772 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.692933 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.692933 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.693228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.693393 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.693618 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.693768 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.693951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.694151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.694314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.694575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.694755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.694923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.695091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.695263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.695426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.695627 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.695798 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.695942 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:31:48.696114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.696280 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.696445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.696606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.696789 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.697006 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.697177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.697339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.697499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.697692 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.697846 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.698026 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.698220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.698484 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.698640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.698850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.699029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.699255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.699431 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.699590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.699745 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.699910 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.700069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.700232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.700398 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.700550 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.700713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.700874 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.701039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.701215 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.701367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.701515 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.701674 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.701837 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.701993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.702166 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.702310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.702470 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.702716 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.702867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.703024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.703193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.703359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.703520 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.703671 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.703834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.704012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.704164 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.704164 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.704450 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.704605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.704762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.704923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.705073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.705218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.705371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.705523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.705671 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.705831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.705985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.706184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.706445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.706599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.706827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.707007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.707196 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.707419 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.707584 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.707750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.707961 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.708118 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.708317 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.708585 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.708774 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.708928 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.709167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.709324 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.709478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.709645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.709809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.709970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.710135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.710285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.710508 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.710780 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.710956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.711113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.711544 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.711746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.711902 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.712098 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.712362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.712558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.712724 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.712929 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.713088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.713279 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.713431 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.713599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.713751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.713908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.714070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.714221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.714375 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.714549 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.714728 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.714877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.715036 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.715189 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.715337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.715509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.715671 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.715825 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.715977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.716143 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.716306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.716475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.716694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.716852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.717003 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.717167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.717322 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.717465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.717607 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.717762 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.717906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.718048 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.718217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.718378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.718523 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.718711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.718902 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.719061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.719227 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.719386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.719537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.719692 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.719851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.720007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.720197 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.720348 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.720499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.720665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.720811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.720977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.721146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.721322 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.721481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.721641 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.721794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.721964 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.722124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.722271 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.722430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.722581 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.722755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.722928 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.723075 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.723217 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.723362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.723524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.723679 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.723852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724170 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724322 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724651 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.724972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.725278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.725441 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.725610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.725765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.725931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.726082 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.726247 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.726247 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.726553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.727656 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.727849 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.728002 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.728184 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.728355 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.728522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.728674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.728824 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.728985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.729148 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.729312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.729458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.729606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.729756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.729901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.730057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.730232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.730397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.730564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.730891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.731043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.731208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.731370 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.731522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.731682 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.731820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.731966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.732115 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.732291 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.732439 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.732583 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.732723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.732998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.733223 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.733223 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.733616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.733616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.733616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.734221 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.734450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.734450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.734858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.735060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.735060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.735449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.735642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.735642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.735642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.736150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.736330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.736330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.736681 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.736879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.736879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.736879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.737438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.737657 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.737657 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738606 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.738853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.739849 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.740102 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.740298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.740492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.740492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.740929 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.741138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.741138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.741138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.741759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.741971 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.741971 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.742443 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.742915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.743449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.743661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.743661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.744098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.744328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.744328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.744328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.744328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.745156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.745371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.745371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.745371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.746061 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.746276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.746276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.746689 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.746920 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.747127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.747387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.747387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.747785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.747993 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.748244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.748467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.748467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.748856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.749071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.749290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.749528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.749528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.749908 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.750104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.750104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.750819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.751105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.751319 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.751620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.751620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.752068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.752284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.752284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.752672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.753074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.753361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.753582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.753582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.754066 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.754271 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.754490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.754772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.755205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.755412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.755412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.755797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.756012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.756227 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.756444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.756628 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.756808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.756808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.757190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.757387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.757387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.757750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.757935 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.758232 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.758497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.758822 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.759047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.759247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.759247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.759636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.759834 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.760027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.760230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.760418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.760599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.760599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.760983 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.761209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.761405 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.761612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.761808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.761988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.762193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.762394 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.762606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.762898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.763126 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.763361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.763566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.763767 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.763767 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.764139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.764139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.764552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.764761 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.764969 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.764969 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.765347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.765347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.765746 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.765967 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.765967 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.766359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.766589 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.766842 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.767047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.767047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.767433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.767650 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.767869 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.768074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.768266 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.768473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.768705 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.768905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.768905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.769281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.769466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.769666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.769857 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.769857 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.770238 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.770427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.770629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.770877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.770877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.771268 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.771487 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.771487 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.771876 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.772099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.772310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.772492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.772492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.772828 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.773001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.773230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.773424 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.773605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.773858 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.774051 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.774242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.774242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.774599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.774884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.775076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.775275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.775275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.775691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.775874 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.776058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.776233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.776233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.776590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.776778 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.776977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.777167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.777167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.777569 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.777774 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.777952 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.778139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.778139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.778477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.778699 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.778895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.779089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.779089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.779473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.779647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.779833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.780019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.780193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.780366 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.780366 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.780699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.780892 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.781097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.781278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.781278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.781621 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.781804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.782000 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.782174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.782174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.782518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.782722 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.782935 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.783111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.783111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.783509 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.783690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.783885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.784204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.784420 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.784640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.784640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.785126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.785341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.785538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.785728 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.785728 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.786130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.786363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.786541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.786781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.786781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.786781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.787286 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.787286 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.787662 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.787860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.788057 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.788252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.788471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.788471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.788869 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.789093 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.789337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.789517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.789517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.789881 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.790081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.790260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.790443 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.790616 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.790898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.790898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.791280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.791468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.791468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.791811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.791988 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.791988 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.792340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.792525 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.792712 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.792905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.792905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.793378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.793557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.793751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.793963 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.793963 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.794338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.794525 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.794783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.794960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.795136 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.795317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.795317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.795676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.795859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.796032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.796218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.796218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.796579 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.796753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.796926 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.797120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.797120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.797508 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.797508 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.797868 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.797868 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.798238 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.798452 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.798636 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.798854 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.799040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.799213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.799213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.799623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.799800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.799985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.800159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.800159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.800506 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.800748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.800933 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.801145 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.801145 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.802222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.802412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.802594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.802900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.802900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.803256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.803438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.803615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.803851 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.803851 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.804222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.804401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.804607 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.804782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.804982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.805263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.805263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.805688 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.805914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.806103 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.806312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.806312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.806780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.806961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.807145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.807327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.807327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.807327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.807845 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.808061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.808246 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.808446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.808661 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.808852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.808852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.809240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.809415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.809597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.809790 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.809790 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.810119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.810347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.810593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.810798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.810798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.811149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.811351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.811527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.811714 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.811905 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.812092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.812092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.812468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.812651 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.812828 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.813029 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.813254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.813442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.813442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.814138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.814420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.814638 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.814879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.815055 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.815233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.815438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.815628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.815828 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.816011 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.816186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.816359 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.816532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.816800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.816800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.817157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.817341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.817341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.817341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.817868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.818055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.818055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.818055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.818055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.818966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.819184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.819184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.819184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.819709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.819893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.819893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.820243 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.820430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.820430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.820920 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821622 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.821809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.822525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.822791 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.822791 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.823174 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.823381 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.823381 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.823381 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.823942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.824141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.824141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.824141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.824736 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.824945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.824945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.824945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.825455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.825676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.825676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.825676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.826177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.826351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.826351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.826351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.826351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.827080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.827264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.827264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.827264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.827264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.828058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.828248 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.828248 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.828647 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.828858 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.828858 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.828858 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.829442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.829644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.829644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.830069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.830270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.830270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.830270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.830950 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.831175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.831175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.831175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.831796 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.832021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.832021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.832021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.832639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.832834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.832834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.832834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.833427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.833641 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.833641 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.834033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.834277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.834277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.834277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.834984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.835232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.835232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.835232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.835814 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.836023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.836023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.836023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.836023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.836890 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.837119 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.837119 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.837506 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.837959 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.837959 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.837959 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.838535 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.838773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.838773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.838773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.839337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.839566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.839566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.839566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.840145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.840364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.840364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.840750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.840975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.840975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.840975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.841560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.841777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.841777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.841777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.842434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.842644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.842644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.842644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.843331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.843586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.843586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.843988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.844185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.844185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.844185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.844803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.845013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.845013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.845473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.845691 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.845691 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.846129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.846344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.846344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.846344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.846975 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.847193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.847193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.847629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.847828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.847828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.847828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.848402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.848611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.848611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.849003 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.849200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.849200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.849200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.849827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850637 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.850955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.852292 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.852762 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.852762 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.852762 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.853340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.853610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.853610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.854022 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.854239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.854239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.854239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.854239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.855086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.855325 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.855530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.855756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.855756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.856194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.856417 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.856417 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.856417 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.857060 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.857278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.857499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.857715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.857715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.857715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.858301 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.858517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.858517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.858957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.859159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.859159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.859159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.859785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.860000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.860000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.860000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.860000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.860785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.861019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.861019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.861019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.861616 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.861818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.861818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.862216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.863304 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.863304 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.863738 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.863960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.863960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.863960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.864560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.864767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.864988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.865198 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.865198 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.865590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.865797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.865797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.865797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.866383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.866587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.866587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.867078 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.867307 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.867307 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.867758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.867962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.867962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.868366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.868582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.868582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.868582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.868582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.869350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.869552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.869552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.869552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.870243 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.870439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.870439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.870439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.871061 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.871275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.871275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.871660 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.871862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.871862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.871862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.872455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.872661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.872661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.873049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.873275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.873275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.873673 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.873881 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.873881 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.873881 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.874486 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.874805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.874805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.875191 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.875402 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.875402 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.875817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.876012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.876012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.876385 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.876584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.876584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.877056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.877626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.877626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.877626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.877626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.878390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.878599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.878599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.879389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.879596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.879596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.879596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880226 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880796 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.880973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.881645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.881832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.881832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.882179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.882421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.882421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.882421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.882421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.883315 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.883543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.883701 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.883701 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.884050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.884226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.884425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.884725 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.884886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.885039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.885341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.885517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.885684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.885949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.886156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.886313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.886554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.886884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.887044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.887299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.887604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.887778 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.888037 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.888348 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.888523 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.888677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.889010 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.889287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.889467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.889622 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.889929 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.890239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.890528 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.890719 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.891024 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.891242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.891524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.891695 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.891881 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.892213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.892420 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.892588 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.892770 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.892921 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.893143 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.893315 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.893524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.893736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.893891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.894127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.894285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.894435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.894588 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.894887 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.895108 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.895272 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.895486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.895794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.895953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.896152 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.896363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.896514 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.896664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.897020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.897185 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.897378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.897528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.897748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.897978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.898160 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.898442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.898636 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.899019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.899194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.899388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.899736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.900077 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.900230 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.900436 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.900587 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.900752 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.901069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.901242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.901469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.901630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.901880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.902141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.902316 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.902483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.902743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.902905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.903165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.903373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.903604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.903800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.904016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.904172 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.904491 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.904699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.904882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.905100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.905293 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.905487 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.905696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.905890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.906087 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.906328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.906521 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.906916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.907954 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.908143 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.908335 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.908335 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.908684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.908873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.908873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.909210 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.909400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.909400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.909748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.909946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.910134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.910319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.910319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.910791 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.910985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.910985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.911348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.911531 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.911531 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.911924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.912101 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.912101 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.912382 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.912539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.912687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.912960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.912960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.913310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.913521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.913521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.913894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.914151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.914151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.914548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.914797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.914797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.915244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.915414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.915565 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.915712 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.915873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.916019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.916165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.916341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.916569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:31:48.916815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.917418 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.918128 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.918797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.919383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.920021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.920646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.921246 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.921817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.922389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.922949 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.923909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.924432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.924987 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.925476 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.925991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.926546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.927117 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.927694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.928193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.928653 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.929146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.929675 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.930785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.931300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.932442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.932442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.932875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.933443 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.934577 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.935544 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.936309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.936921 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.937823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.938480 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.939395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.939941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.940509 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.941059 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.941643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.942580 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.943327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.943806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.945531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.945531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.945531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.946435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.946956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.947654 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.948186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.948692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.949258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.950098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.950761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.951419 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.951984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.952570 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.953660 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.954224 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.954812 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.955376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.955964 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.956537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.957102 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.957627 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.958222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.958761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.959373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.960152 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.960506 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.961102 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.961741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.962261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.963061 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.963587 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.964567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.965259 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.965770 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.966506 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.967137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.967701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.968257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.968846 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.969434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.969997 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.970580 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.971194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.971776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.972363 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.972901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.973470 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.974039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.974593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.975203 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.975766 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.976340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.977288 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.978386 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.979064 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.979522 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO dbcounter [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Registered counter for database nova_api Aug 24 03:31:48.979698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.980317 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.981202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.981999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.983445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.983445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.983995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.984842 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.985221 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.985910 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.986540 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.987273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.987737 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.988625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.989132 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.989778 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.990377 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.991057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.991645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.992274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.992920 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.993637 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.994208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.995247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.995604 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.996316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.997175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.997498 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.998329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.999401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:48.999971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.000691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.001555 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.002034 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.002528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_db.sqlalchemy.engines [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.002861 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.003799 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.004152 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.004772 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.005331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.005882 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.006455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.007068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.007643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.008234 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.008801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.009344 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.009821 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.010339 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.010853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.011322 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.011431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writer thread running {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.011819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.012351 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.012911 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.013567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.014045 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.014602 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.015215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.015758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.016306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.016819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.017335 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.017889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.018440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.019024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.019586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.020132 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.020696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.021254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.021833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.022430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.023036 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.023664 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.024311 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.024855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.025445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.025988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.026547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.027258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.027813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.028482 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.029262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.029856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.030502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.031108 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.031667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.032245 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.032783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.033613 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.034134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.034742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.035353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.036011 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.036743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.037310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.037892 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.038521 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.039026 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.039624 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.040082 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.040638 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.041148 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.041687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:31:49.042074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:31:49.074156 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.context [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97a45c54-1fe5-4470-83ef-9fef2d361903(cell1) {{(pid=127257) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:31:49.078468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.078991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.080638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.081442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.081891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.084122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.086408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO dbcounter [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Registered counter for database nova_cell0 Aug 24 03:31:49.091705 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO dbcounter [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Registered counter for database nova_cell1 Aug 24 03:31:49.103302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_db.sqlalchemy.engines [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.104127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_db.sqlalchemy.engines [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.112206 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writer thread running {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.113555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writer thread running {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.171852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO dbcounter [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Registered counter for database nova_api Aug 24 03:31:49.213040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_db.sqlalchemy.engines [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.225027 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writer thread running {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.269433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO dbcounter [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Registered counter for database nova_cell0 Aug 24 03:31:49.278787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_db.sqlalchemy.engines [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.284399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writer thread running {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.340983 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.context [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97a45c54-1fe5-4470-83ef-9fef2d361903(cell1) {{(pid=127258) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:31:49.345421 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.346118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.348395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.349442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.350142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.353181 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.355681 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO dbcounter [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Registered counter for database nova_cell0 Aug 24 03:31:49.360587 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO dbcounter [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Registered counter for database nova_cell1 Aug 24 03:31:49.369599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_db.sqlalchemy.engines [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.372669 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_db.sqlalchemy.engines [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.379820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writer thread running {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.381818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writer thread running {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.605480 dv-cinder-854260-1-smb devstack@n-api.service[127257]: WARNING keystonemiddleware.auth_token [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:31:49.610343 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO dbcounter [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Registered counter for database nova_cell0 Aug 24 03:31:49.613106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: WARNING keystonemiddleware.auth_token [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:31:49.620089 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_db.sqlalchemy.engines [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:31:49.625624 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writer thread running {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:31:49.954887 dv-cinder-854260-1-smb devstack@n-api.service[127258]: WARNING keystonemiddleware.auth_token [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:31:49.961666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: WARNING keystonemiddleware.auth_token [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:31:49.963394 dv-cinder-854260-1-smb devstack@n-api.service[127258]: WARNING keystonemiddleware.auth_token [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:31:49.968014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: WARNING keystonemiddleware.auth_token [None req-6244f5cc-e012-4548-b5c9-63b4330fdb89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:31:49.973457 dv-cinder-854260-1-smb devstack@n-api.service[127257]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b3c30f9c0 pid: 127257 (default app) Aug 24 03:31:50.318779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: WARNING keystonemiddleware.auth_token [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:31:50.325597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: WARNING keystonemiddleware.auth_token [None req-eba8fc2d-54fe-4f2e-a58b-87e2d3451bef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:31:50.331103 dv-cinder-854260-1-smb devstack@n-api.service[127258]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561b3c30f9c0 pid: 127258 (default app) Aug 24 03:32:30.611462 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:30.614263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:30.615602 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:30.617894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.252536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=3 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.253914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=3 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.255863 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=3 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.257462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=3 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:33.036894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dfd4ed0e-514a-4053-b200-4026da5ca2fd tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Action: 'create', calling method: .version_select at 0x7f4f4635b5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-912569613"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:33.100982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d0fecbd6-f4c1-4630-994b-da23d807b73f tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Action: 'create', calling method: .version_select at 0x7f4f462df5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1005279472", "metadata": {"Type": "work"}}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:34.487905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dfd4ed0e-514a-4053-b200-4026da5ca2fd tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.892600 Aug 24 03:32:34.488990 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1155 bytes} [Wed Aug 24 03:32:30 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3895 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:32:34.594732 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd2eb2b4-8716-4e6e-9a89-98e5bea980bb tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461b04c0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:34.692988 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dd2eb2b4-8716-4e6e-9a89-98e5bea980bb tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8" status: 200 len: 344 microversion: 2.1 time: 0.188265 Aug 24 03:32:34.694014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 2/2] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:34 2022] GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:35.178791 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d0fecbd6-f4c1-4630-994b-da23d807b73f tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.947374 Aug 24 03:32:35.179985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 24 03:32:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3954 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 03:32:35.195504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-96ec973b-8be5-4164-8ba9-89d4b18eed2f tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Calling method '.version_select at 0x7f4f461b0b80>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.301608 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-96ec973b-8be5-4164-8ba9-89d4b18eed2f tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf" status: 200 len: 353 microversion: 2.1 time: 0.110296 Aug 24 03:32:35.317785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:35.511976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5aa3c6b9-d8b8-40f3-9a8d-0dbea9059508 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f461b24c0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.629187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5aa3c6b9-d8b8-40f3-9a8d-0dbea9059508 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/40d51e4d-04b4-4e25-951c-f058b48ba8f2" status: 200 len: 350 microversion: 2.1 time: 0.121878 Aug 24 03:32:35.630874 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 2/5] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/os-volumes/40d51e4d-04b4-4e25-951c-f058b48ba8f2 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:35.709011 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3d42497f-0b91-4efb-9e71-75c84ea424aa tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461c7310>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.858301 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3d42497f-0b91-4efb-9e71-75c84ea424aa tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8" status: 200 len: 345 microversion: 2.1 time: 0.153830 Aug 24 03:32:35.868142 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 4/6] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:35.873289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-65cce6ad-3ba6-48e2-9cc9-e18a7eea0ab5 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Action: 'create', calling method: .version_select at 0x7f4f461b2b80>, body: {"snapshot": {"volume_id": "59762678-70af-47bd-b19d-b7b0faf089f8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1067493716"}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:36.330450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1634931f-9057-41c8-a85d-05b64999a3c8 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Calling method '.version_select at 0x7f4f461b0b80>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.653333 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-65cce6ad-3ba6-48e2-9cc9-e18a7eea0ab5 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.783952 Aug 24 03:32:36.654956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 3/7] 10.222.0.78 () {60 vars in 1162 bytes} [Wed Aug 24 03:32:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:36.670739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-772c2cf1-0e48-44ea-b0e8-5f7b4c2f4f79 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461caca0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.710145 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1634931f-9057-41c8-a85d-05b64999a3c8 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf" status: 200 len: 354 microversion: 2.1 time: 0.385652 Aug 24 03:32:36.711600 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf => generated 354 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:36.735918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b9ed970b-22cd-48be-a08b-89defeaf1d18 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Calling method '.version_select at 0x7f4f461b04c0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.869332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-772c2cf1-0e48-44ea-b0e8-5f7b4c2f4f79 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce" status: 200 len: 287 microversion: 2.1 time: 0.206303 Aug 24 03:32:36.872818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 4/9] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce => generated 287 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:36.896060 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fa431b70-cad5-409e-b93f-5af2bb7e33d8 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461ca790>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.951788 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b9ed970b-22cd-48be-a08b-89defeaf1d18 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf" status: 200 len: 354 microversion: 2.1 time: 0.223119 Aug 24 03:32:36.952934 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 6/10] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:36.991433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7604fdfa-4ec7-4125-ac4c-5dc9621a31c1 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Calling method '.version_select at 0x7f4f461c7550>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.034366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fa431b70-cad5-409e-b93f-5af2bb7e33d8 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.147564 Aug 24 03:32:37.039013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 5/11] 10.222.0.78 () {58 vars in 1140 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:37.055319 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4700bc0a-c2e9-40b3-bc90-bd58ae609f8d tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461b2820>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.135842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7604fdfa-4ec7-4125-ac4c-5dc9621a31c1 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf" status: 202 len: 0 microversion: 2.1 time: 0.148318 Aug 24 03:32:37.136438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 7/12] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:32:36 2022] DELETE /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:32:37.147877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3c251c72-341c-4a47-851d-72775d61a685 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Calling method '.version_select at 0x7f4f461b0280>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.181160 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4700bc0a-c2e9-40b3-bc90-bd58ae609f8d tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce" status: 200 len: 287 microversion: 2.1 time: 0.132015 Aug 24 03:32:37.181846 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:37.278909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3c251c72-341c-4a47-851d-72775d61a685 tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf" status: 200 len: 353 microversion: 2.1 time: 0.135249 Aug 24 03:32:37.281407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 8/14] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:37.694726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5e4e91ac-6fbd-4651-b924-d1e8fbc22ae5 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f462df670>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.815108 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5e4e91ac-6fbd-4651-b924-d1e8fbc22ae5 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fde1fad-a12e-4c22-99d4-a28d5fb35137" status: 200 len: 351 microversion: 2.1 time: 0.131404 Aug 24 03:32:37.832566 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 7/15] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/os-volumes/6fde1fad-a12e-4c22-99d4-a28d5fb35137 => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:38.201657 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2bcd7105-0bdc-433a-96bf-f624bf42cbea tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461b08b0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.276700 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2bcd7105-0bdc-433a-96bf-f624bf42cbea tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce" status: 200 len: 288 microversion: 2.1 time: 0.082550 Aug 24 03:32:38.277469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce => generated 288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:38.295998 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9479e2ce-f2fd-4369-9de5-3b4484e089dd tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461b2820>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.297492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a41e0e50-ff66-42d5-bb87-622ed39d9bdc tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Calling method '.version_select at 0x7f4f461c7040>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.380924 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-a41e0e50-ff66-42d5-bb87-622ed39d9bdc tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] HTTP exception thrown: Volume 87ca5169-c341-4cb9-ba12-bbec38f5a7bf could not be found. Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a41e0e50-ff66-42d5-bb87-622ed39d9bdc tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Request method failure captured: Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf HTTP/1.1 Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvPA8BK6Gs-zINfcdWYmJAJD1jsxS2-B9iRSRCGsELTNC9caygkGf94zVeB-JdzjkhVTYgB9eGTfruugkA9qbTxRUtD9hMoWU69rCx-c9mF3_V_fAU8vH5tMErqSGs_tmtWESeVFNa1T7z2kAj056gJkR0jMHYYQMO2QnKK9MCSDKg Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: d32cfa50483640e7b56a1cf1dea66962 Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesGetTestJSON-487872516 Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:32:38.414085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d32cfa50483640e7b56a1cf1dea66962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d32cfa50483640e7b56a1cf1dea66962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d32cfa50483640e7b56a1cf1dea66962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d32cfa50483640e7b56a1cf1dea66962"}]}] Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesGetTestJSON-487872516 Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: d32cfa50483640e7b56a1cf1dea66962 Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesGetTestJSON-487872516 Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesGetTestJSON-487872516-project Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 9a959849555c454d824342fa4eb7470d Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesGetTestJSON-487872516-project Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Volume 87ca5169-c341-4cb9-ba12-bbec38f5a7bf could not be found. Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '87ca5169-c341-4cb9-ba12-bbec38f5a7bf'} Aug 24 03:32:38.415543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87ca5169-c341-4cb9-ba12-bbec38f5a7bf could not be found. (HTTP 404) (Request-ID: req-e573f33c-e658-4979-8768-8ce7987c5a87) Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:38.416327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:38.417239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87ca5169-c341-4cb9-ba12-bbec38f5a7bf could not be found. Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:32:38.418089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87ca5169-c341-4cb9-ba12-bbec38f5a7bf could not be found. Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87ca5169-c341-4cb9-ba12-bbec38f5a7bf could not be found. Aug 24 03:32:38.419054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:38.420496 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a41e0e50-ff66-42d5-bb87-622ed39d9bdc tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] Returning 404 to user: Volume 87ca5169-c341-4cb9-ba12-bbec38f5a7bf could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:38.429856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a41e0e50-ff66-42d5-bb87-622ed39d9bdc tempest-VolumesGetTestJSON-487872516 tempest-VolumesGetTestJSON-487872516-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf" status: 404 len: 109 microversion: 2.1 time: 0.134524 Aug 24 03:32:38.434749 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 10/17] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/os-volumes/87ca5169-c341-4cb9-ba12-bbec38f5a7bf => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:38.723283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9479e2ce-f2fd-4369-9de5-3b4484e089dd tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce" status: 202 len: 0 microversion: 2.1 time: 0.436267 Aug 24 03:32:38.724213 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 8/18] 10.222.0.78 () {58 vars in 1254 bytes} [Wed Aug 24 03:32:38 2022] DELETE /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:32:38.738424 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-33044098-7a82-4e63-bfde-64270b4ee0f8 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461c7dc0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.849522 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-33044098-7a82-4e63-bfde-64270b4ee0f8 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce" status: 200 len: 287 microversion: 2.1 time: 0.117618 Aug 24 03:32:38.853693 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 11/19] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:39.813229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-147d4cec-1f31-4fd0-91a0-ec5e95353115 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f46b89af0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:39.870029 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c7eaf07c-b8eb-4a69-b155-6296c242905c tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461364c0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:39.959947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-147d4cec-1f31-4fd0-91a0-ec5e95353115 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b5820530-cd36-4cce-846e-768d602a3402" status: 200 len: 351 microversion: 2.1 time: 0.150855 Aug 24 03:32:39.968972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 9/20] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:39 2022] GET /compute/v2.1/os-volumes/b5820530-cd36-4cce-846e-768d602a3402 => generated 351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:39.974219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a53432eb-9d39-4d84-af23-81b1c53f91e1 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f461cac10>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.029419 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-c7eaf07c-b8eb-4a69-b155-6296c242905c tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] HTTP exception thrown: Snapshot f48bf213-4498-417e-b397-4f9c98c376ce could not be found. Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c7eaf07c-b8eb-4a69-b155-6296c242905c tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Request method failure captured: Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce HTTP/1.1 Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvOayOLBsOejKVvmhPAsxBaFyEwfaPW7UZIYx_T1BJprxOfM0uAgXdSMjmv2NR4xJUx_mBOEvVgv9rG-nhRanuIZDUrShLgJToSmAQnjr6aCOzHDWx6Lh_7-zUbiE1kPCvzEyV4M-ZQKjFDL4JSUtVvpLtrj9drGRY3iJnKpdXrh24 Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:32:40.031736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2756fd68c251459dac37e4ef4f6ae8e0"}]}] Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: bc15e6a23f82446c8026be62782c1071 Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Snapshot f48bf213-4498-417e-b397-4f9c98c376ce could not be found. Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': 'f48bf213-4498-417e-b397-4f9c98c376ce'} Aug 24 03:32:40.033698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f48bf213-4498-417e-b397-4f9c98c376ce could not be found. (HTTP 404) (Request-ID: req-7f8d6aa1-4133-4027-9141-0d1cfe6fbb38) Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:40.041378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:40.043375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f48bf213-4498-417e-b397-4f9c98c376ce could not be found. Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 03:32:40.045254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f48bf213-4498-417e-b397-4f9c98c376ce could not be found. Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f48bf213-4498-417e-b397-4f9c98c376ce could not be found. Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c7eaf07c-b8eb-4a69-b155-6296c242905c tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Returning 404 to user: Snapshot f48bf213-4498-417e-b397-4f9c98c376ce could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:40.050542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c7eaf07c-b8eb-4a69-b155-6296c242905c tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce" status: 404 len: 111 microversion: 2.1 time: 0.167737 Aug 24 03:32:40.053807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 12/21] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 24 03:32:39 2022] GET /compute/v2.1/os-snapshots/f48bf213-4498-417e-b397-4f9c98c376ce => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:32:40.053807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-99158acf-2531-414a-a76b-42e6f221d33d tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f4635bee0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.224413 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a53432eb-9d39-4d84-af23-81b1c53f91e1 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.254075 Aug 24 03:32:40.225029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 10/22] 10.222.0.78 () {58 vars in 1134 bytes} [Wed Aug 24 03:32:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:40.244309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f604372b-8432-44e3-b33d-54abb48d03e5 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f461ca8b0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.320254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-99158acf-2531-414a-a76b-42e6f221d33d tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8" status: 202 len: 0 microversion: 2.1 time: 0.277876 Aug 24 03:32:40.320621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 13/23] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:32:40 2022] DELETE /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:32:40.333280 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d70fa725-ca5f-4931-9164-ddd9998b5326 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f46136160>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.448745 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f604372b-8432-44e3-b33d-54abb48d03e5 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.208639 Aug 24 03:32:40.449751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 11/24] 10.222.0.78 () {58 vars in 1149 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:40.468174 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-dec82924-66db-40e3-a761-882e69e1cb41 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f461b2e50>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.542578 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d70fa725-ca5f-4931-9164-ddd9998b5326 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8" status: 200 len: 344 microversion: 2.1 time: 0.216315 Aug 24 03:32:40.550020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 14/25] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:40.700301 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-dec82924-66db-40e3-a761-882e69e1cb41 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.239639 Aug 24 03:32:40.700885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 12/26] 10.222.0.78 () {58 vars in 1134 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:40.717146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e77b7249-6cd6-4bb9-86e5-ab4861332eef tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f461c7dc0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.933516 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e77b7249-6cd6-4bb9-86e5-ab4861332eef tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.223190 Aug 24 03:32:40.935912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1167 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:40.950578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7063f7c8-7bd3-4f85-9c84-836b6b159668 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f461d69d0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.165291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7063f7c8-7bd3-4f85-9c84-836b6b159668 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.219169 Aug 24 03:32:41.166422 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 13/28] 10.222.0.78 () {58 vars in 1170 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:41.186704 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-847190c3-4f30-45fe-99c7-540195a04c74 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f46136820>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.402031 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-847190c3-4f30-45fe-99c7-540195a04c74 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.219819 Aug 24 03:32:41.403455 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 16/29] 10.222.0.78 () {58 vars in 1155 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:41.442019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-89fb1907-b45b-4c0a-b792-124b68419725 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f46b899d0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.561479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6dee7d7c-2735-4077-bf92-e40dc714c2e4 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f46137dc0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.640099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-6dee7d7c-2735-4077-bf92-e40dc714c2e4 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] HTTP exception thrown: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6dee7d7c-2735-4077-bf92-e40dc714c2e4 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Request method failure captured: Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 HTTP/1.1 Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvOayOLBsOejKVvmhPAsxBaFyEwfaPW7UZIYx_T1BJprxOfM0uAgXdSMjmv2NR4xJUx_mBOEvVgv9rG-nhRanuIZDUrShLgJToSmAQnjr6aCOzHDWx6Lh_7-zUbiE1kPCvzEyV4M-ZQKjFDL4JSUtVvpLtrj9drGRY3iJnKpdXrh24 Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:32:41.642275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2756fd68c251459dac37e4ef4f6ae8e0"}]}] Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: bc15e6a23f82446c8026be62782c1071 Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '59762678-70af-47bd-b19d-b7b0faf089f8'} Aug 24 03:32:41.643555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. (HTTP 404) (Request-ID: req-b6a28fb8-27d3-4b51-a788-cefbe96a5e5d) Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.644302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:41.645221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:32:41.646077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6dee7d7c-2735-4077-bf92-e40dc714c2e4 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Returning 404 to user: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6dee7d7c-2735-4077-bf92-e40dc714c2e4 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8" status: 404 len: 109 microversion: 2.1 time: 0.089036 Aug 24 03:32:41.647055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 17/30] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:32:41.660038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cda90724-aa45-42f1-8da6-3b38a848a17f tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f461373a0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.711959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-89fb1907-b45b-4c0a-b792-124b68419725 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.274651 Aug 24 03:32:41.712924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 14/31] 10.222.0.78 () {58 vars in 1188 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:41.728183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8783da20-37f4-443f-ae32-9615a6ea41e5 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] Calling method '.version_select at 0x7f4f461d6940>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.789729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-cda90724-aa45-42f1-8da6-3b38a848a17f tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] HTTP exception thrown: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cda90724-aa45-42f1-8da6-3b38a848a17f tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Request method failure captured: Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 HTTP/1.1 Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvOayOLBsOejKVvmhPAsxBaFyEwfaPW7UZIYx_T1BJprxOfM0uAgXdSMjmv2NR4xJUx_mBOEvVgv9rG-nhRanuIZDUrShLgJToSmAQnjr6aCOzHDWx6Lh_7-zUbiE1kPCvzEyV4M-ZQKjFDL4JSUtVvpLtrj9drGRY3iJnKpdXrh24 Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:32:41.791742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2756fd68c251459dac37e4ef4f6ae8e0"}]}] Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: bc15e6a23f82446c8026be62782c1071 Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '59762678-70af-47bd-b19d-b7b0faf089f8'} Aug 24 03:32:41.792814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. (HTTP 404) (Request-ID: req-7280dd44-2ec7-4200-b0d9-64f6722ccf8b) Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.793540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:32:41.794502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:32:41.795415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cda90724-aa45-42f1-8da6-3b38a848a17f tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Returning 404 to user: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:41.796262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cda90724-aa45-42f1-8da6-3b38a848a17f tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8" status: 404 len: 109 microversion: 2.1 time: 0.138738 Aug 24 03:32:41.800580 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 18/32] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:32:41 2022] DELETE /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:41.817736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ed8adfba-85f5-4282-a339-aeeffe982912 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Calling method '.version_select at 0x7f4f46b88a60>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.898173 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-ed8adfba-85f5-4282-a339-aeeffe982912 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] HTTP exception thrown: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ed8adfba-85f5-4282-a339-aeeffe982912 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Request method failure captured: Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 HTTP/1.1 Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvOayOLBsOejKVvmhPAsxBaFyEwfaPW7UZIYx_T1BJprxOfM0uAgXdSMjmv2NR4xJUx_mBOEvVgv9rG-nhRanuIZDUrShLgJToSmAQnjr6aCOzHDWx6Lh_7-zUbiE1kPCvzEyV4M-ZQKjFDL4JSUtVvpLtrj9drGRY3iJnKpdXrh24 Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:32:41.900179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2756fd68c251459dac37e4ef4f6ae8e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2756fd68c251459dac37e4ef4f6ae8e0"}]}] Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 2756fd68c251459dac37e4ef4f6ae8e0 Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1499535235 Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: bc15e6a23f82446c8026be62782c1071 Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1499535235-project Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '59762678-70af-47bd-b19d-b7b0faf089f8'} Aug 24 03:32:41.901236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. (HTTP 404) (Request-ID: req-8c2caad0-4bd8-4140-a21a-a75c6ebffe4f) Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.901839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:32:41.902812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:32:41.903684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ed8adfba-85f5-4282-a339-aeeffe982912 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] Returning 404 to user: Volume 59762678-70af-47bd-b19d-b7b0faf089f8 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:41.904609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ed8adfba-85f5-4282-a339-aeeffe982912 tempest-VolumesSnapshotsTestJSON-1499535235 tempest-VolumesSnapshotsTestJSON-1499535235-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8" status: 404 len: 109 microversion: 2.1 time: 0.100386 Aug 24 03:32:41.914885 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 19/33] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/os-volumes/59762678-70af-47bd-b19d-b7b0faf089f8 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:41.981704 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8783da20-37f4-443f-ae32-9615a6ea41e5 tempest-VolumesTestJSON-1287295312 tempest-VolumesTestJSON-1287295312-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.258220 Aug 24 03:32:41.996937 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 15/34] 10.222.0.78 () {58 vars in 1155 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:48.897812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8d3937c6-c38e-420f-b465-52f4ed4ce666 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'create', calling method: .version_select at 0x7f4f46137670>, body: {"keypair": {"name": "tempest-keypair-1367747453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3LT9qKNnXM6pe4ILIbXR9jKYP4bzmAIkAemrXkZFhGWxKNNpJAJeJDrKaGc40G6WnuFaflP6bURzCCs4nslD2giM+yQ23rdTZklr5Ne++NXunWVKwaVskMSksQeJlNDA=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:49.033298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-8d3937c6-c38e-420f-b465-52f4ed4ce666 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:49.050582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-8d3937c6-c38e-420f-b465-52f4ed4ce666 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for user 1507cffe84dc4849a7040333ad48d99c and project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:49.202229 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8d3937c6-c38e-420f-b465-52f4ed4ce666 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.912517 Aug 24 03:32:49.203641 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 20/35] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:32:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:52.433546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-407162416", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "networks": [{"uuid": "0419c17e-3dd7-41a3-bfd3-60f37939efae"}]}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:52.881662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] validate_networks() for [('0419c17e-3dd7-41a3-bfd3-60f37939efae', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:55.888980 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:55.891445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:55.896877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:55.900149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:55.907151 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:56.014743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.020865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.026990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.032541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.033498 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.034280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.125760 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Getting quotas for project 9c423ab6ae8843d0a65df1f706a3c41e. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:56.141413 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Getting quotas for user c8969ad404a44181b719c5546230c49a and project 9c423ab6ae8843d0a65df1f706a3c41e. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:56.160426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:56.165804 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:56.353954 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-23335ce1-7405-45c3-b357-2228e704d0cf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.198468 Aug 24 03:32:56.355353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 16/36] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:32:56.375912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1a3f25b8-e9c6-4024-ae90-3bae3bcddeae tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:56.383853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1a3f25b8-e9c6-4024-ae90-3bae3bcddeae tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:56.810947 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1a3f25b8-e9c6-4024-ae90-3bae3bcddeae tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:56.857197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1a3f25b8-e9c6-4024-ae90-3bae3bcddeae tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1214 microversion: 2.1 time: 0.483402 Aug 24 03:32:56.863346 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 21/37] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:56 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1214 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:57.899877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-23556c20-284e-4a6b-b65e-a14726a80e56 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:57.906111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-23556c20-284e-4a6b-b65e-a14726a80e56 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:58.218508 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-23556c20-284e-4a6b-b65e-a14726a80e56 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:58.259922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-23556c20-284e-4a6b-b65e-a14726a80e56 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1214 microversion: 2.1 time: 0.373275 Aug 24 03:32:58.271122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 17/38] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:57 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:59.120565 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f0a6fec6-093e-4fe6-b81c-c3be1b5dab23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'create', calling method: .version_select at 0x7f4f45872280>, body: {"keypair": {"name": "tempest-keypair-2037068014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUocz7a2tTXMfdXqC6nPxkqW1J9vwb8H41De/l3m/gMdhhVaYsVu2wYUazPFASSVeO6ze8I7wlvLd89Okh1aRfdZjIt8x6Me7wtLjlrfuswICQcs0WpEHMvWgy9j2gLLw=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:59.162097 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-f0a6fec6-093e-4fe6-b81c-c3be1b5dab23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for project 70bebe773822488a90a1258551c3f09b. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:59.185968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-f0a6fec6-093e-4fe6-b81c-c3be1b5dab23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for user 45285b561f424fde9297724c6768250d and project 70bebe773822488a90a1258551c3f09b. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:59.245191 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f0a6fec6-093e-4fe6-b81c-c3be1b5dab23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.251799 Aug 24 03:32:59.248040 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 22/39] 10.222.0.78 () {62 vars in 1200 bytes} [Wed Aug 24 03:32:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1256 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 03:32:59.302866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f34a408d-2ddf-428f-943e-3ceef8791e42 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:59.304018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f34a408d-2ddf-428f-943e-3ceef8791e42 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:59.521922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f34a408d-2ddf-428f-943e-3ceef8791e42 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:59.537245 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f34a408d-2ddf-428f-943e-3ceef8791e42 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1214 microversion: 2.1 time: 0.238583 Aug 24 03:32:59.545157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 18/40] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:59 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:00.580098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d00ad0ae-6a7f-4a41-ac8c-7a9486fb1716 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:00.586467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d00ad0ae-6a7f-4a41-ac8c-7a9486fb1716 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:00.778408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-179c496d-c266-4fe3-8f9b-b30b43eba573 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: .version_select at 0x7f4f4588c550>, body: {"keypair": {"name": "tempest-keypair-194878468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+zl2Zx6voWbJPt4RH4FK1NzwjX334sijO2rVn3ovhbd8fJysVnioCEtQbSaY/8hLLlFGmdWPSKvUFKR1WQtZQXWnkRzP9K3x4KuG1h6tLWcnyYbRw/g66lsZEFKwrUaQ=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:00.800835 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d00ad0ae-6a7f-4a41-ac8c-7a9486fb1716 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:00.852342 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d00ad0ae-6a7f-4a41-ac8c-7a9486fb1716 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1214 microversion: 2.1 time: 0.264809 Aug 24 03:33:00.853507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 19/41] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:00 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:00.857156 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-179c496d-c266-4fe3-8f9b-b30b43eba573 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:00.871623 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-179c496d-c266-4fe3-8f9b-b30b43eba573 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:00.946193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-179c496d-c266-4fe3-8f9b-b30b43eba573 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.466186 Aug 24 03:33:00.947925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 23/42] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:32:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:01.173126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1623342158", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d345d2d-fcdb-4acc-8902-c21c26cd29f1"}], "security_groups": [{"name": "tempest-securitygroup--1971016718"}], "key_name": "tempest-keypair-1367747453", "user_data": "}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:01.838915 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] validate_networks() for [('9d345d2d-fcdb-4acc-8902-c21c26cd29f1', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:33:01.904227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:01.905564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:01.939015 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:01.941616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:01.942099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:01.945421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:01.945937 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:01.950946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:02.503446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:02.555374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b950d390-eede-46ad-a3f4-e9a5b3bb34e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1266 microversion: 2.1 time: 0.663609 Aug 24 03:33:02.556584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 24/43] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:01 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1266 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:03.622021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:03.625761 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:03.647747 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.652921 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.653915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.658290 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.659208 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.660005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:04.040226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:04.062184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2c1f38e7-b8c3-4b08-97fc-84f6ab9080b2 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1272 microversion: 2.1 time: 0.463040 Aug 24 03:33:04.067538 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 25/44] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:03 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1272 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:04.207697 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:33:04.208219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:33:04.208843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:33:04.209256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:33:04.209665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:33:04.233890 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:04.234404 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:04.234888 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:04.246360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:04.247036 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:04.247495 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:04.330481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:04.350547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for user 1507cffe84dc4849a7040333ad48d99c and project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:04.389804 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:33:04.402305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:33:04.618536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-86646ae2-0f3f-4bad-8652-1bba8c057d81 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.464939 Aug 24 03:33:04.653128 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-44093f3d-cc73-4b89-bffb-62fceb83969e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:04.653990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 20/45] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:33:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 3502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:33:04.655129 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-44093f3d-cc73-4b89-bffb-62fceb83969e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:05.116196 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:05.117636 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:05.148489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.149096 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.151271 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.154640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.160058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.161333 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.258477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-44093f3d-cc73-4b89-bffb-62fceb83969e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:05.283607 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-44093f3d-cc73-4b89-bffb-62fceb83969e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1238 microversion: 2.1 time: 0.639352 Aug 24 03:33:05.289262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 26/46] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:04 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1238 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:06.335859 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:06.336906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a39a4ca0-6a92-4dcf-a37e-82b6ae2d1003 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:06.338532 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a39a4ca0-6a92-4dcf-a37e-82b6ae2d1003 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:06.376237 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-57b1bd4c-a06f-4c57-af16-aa22d40a200d tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1272 microversion: 2.1 time: 1.261407 Aug 24 03:33:06.382918 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 21/47] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:05 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1272 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:06.439958 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-437535584", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63d91dce-acd7-4f8a-97fb-8e912e624ee3"}], "security_groups": [{"name": "tempest-securitygroup--1776374870"}], "key_name": "tempest-keypair-2037068014", "user_data": "}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:06.834633 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a39a4ca0-6a92-4dcf-a37e-82b6ae2d1003 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:06.848099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a39a4ca0-6a92-4dcf-a37e-82b6ae2d1003 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1238 microversion: 2.1 time: 0.535222 Aug 24 03:33:06.851347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 27/48] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:06 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1238 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:07.140030 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] validate_networks() for [('63d91dce-acd7-4f8a-97fb-8e912e624ee3', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:33:07.440546 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:07.449867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:07.505418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.507867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.511479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.512725 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.517708 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.518558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.892078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:07.908305 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-08769c90-4876-4ec8-9111-b1df87fde1b7 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1272 microversion: 2.1 time: 0.516263 Aug 24 03:33:07.912093 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 28/49] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:07 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1272 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:07.925406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:07.933085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:07.949360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.950645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.953382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.955431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.957973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.962487 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.310589 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:08.333300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8b197bf4-19f2-4784-bea9-f7240da9743d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1234 microversion: 2.1 time: 0.418719 Aug 24 03:33:08.338891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 29/50] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:07 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1234 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:08.936507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:08.937216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:08.965825 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.968772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.973895 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.975255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.975785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.982741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:10.728643 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:10.743495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7721f456-55a6-4d84-976c-e02e00799cc6 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 1.814021 Aug 24 03:33:10.771213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 30/51] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:08 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:10.786571 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:10.794349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:10.796995 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:10.822089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:10.830783 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:10.831743 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:10.832666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:10.844970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:10.845846 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.110995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:33:11.128931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:33:11.130465 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:33:11.131533 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:33:11.135481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:33:11.159116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.160342 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.161297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.163352 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.164423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.213560 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:11.224524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.294811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6a4e1b26-720e-46fc-a5a6-e8b42e7a9e72 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1296 microversion: 2.1 time: 0.521313 Aug 24 03:33:11.303830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 31/52] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:10 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1296 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:11.356670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1402082225", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f5f140-61b8-4d93-a685-1b439b420020"}], "security_groups": [{"name": "tempest-securitygroup--1747636796"}], "key_name": "tempest-keypair-194878468", "user_data": "}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:11.413145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for project 70bebe773822488a90a1258551c3f09b. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:11.436933 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for user 45285b561f424fde9297724c6768250d and project 70bebe773822488a90a1258551c3f09b. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:11.517951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:33:11.522090 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:33:11.711742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b72cf3c2-ae4b-4152-ac3c-7250c086c99c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.279306 Aug 24 03:33:11.714070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 22/53] 10.222.0.78 () {62 vars in 1188 bytes} [Wed Aug 24 03:33:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 5283 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:33:11.730799 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b6dbf070-9400-4890-bbe9-f951d2686b16 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:11.731738 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b6dbf070-9400-4890-bbe9-f951d2686b16 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.229789 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b6dbf070-9400-4890-bbe9-f951d2686b16 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.247745 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b6dbf070-9400-4890-bbe9-f951d2686b16 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.249723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b6dbf070-9400-4890-bbe9-f951d2686b16 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.258680 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b6dbf070-9400-4890-bbe9-f951d2686b16 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1281 microversion: 2.20 time: 0.533893 Aug 24 03:33:12.259996 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 23/54] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:11 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1281 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:12.270937 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:12.271650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.298062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.299629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.302794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.303786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.304172 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.304625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.530555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] validate_networks() for [('f9f5f140-61b8-4d93-a685-1b439b420020', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:33:15.258394 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:15.272366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5ae8b97f-bd23-4b1a-bd17-3bee3d8d5948 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 3.008856 Aug 24 03:33:15.273071 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 24/55] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:12 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 3013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:15.288646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:15.290154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:15.353296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.354694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.355939 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.359251 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.364702 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.367198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.711914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:15.743741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-92bb5498-a0e2-4787-bf8e-978f833e6561 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1296 microversion: 2.1 time: 0.468504 Aug 24 03:33:15.750251 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 25/56] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:15 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1296 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:15.760043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:15.775421 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:15.800832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.801421 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.802024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.802841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.803332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.803784 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.475822 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.516409 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.525578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.526875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-63eaf969-f932-436f-aff5-40e8d01208a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1339 microversion: 2.20 time: 0.771316 Aug 24 03:33:16.527557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 26/57] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:15 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1339 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:16.848948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=18 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:16.983636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:33:16.984432 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:33:16.985654 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:33:16.986638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:33:16.987634 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:33:17.050461 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.051823 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.052961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.054910 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.067960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.072033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.174126 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:17.187875 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:17.274452 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:33:17.314191 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:33:17.468374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-d22c3206-21df-479b-9bb3-4a41338604f1 req-f41b4131-a1b8-4b71-8cd5-2b0171771f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fcdb504-ee37-415b-9a1c-60efdf7b3c82", "tag": "27e0b2b9-5ea2-4134-9705-162b267717ae"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:17.496698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c545639a-9bce-4cb0-9f60-95f73ea8ebe3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.190855 Aug 24 03:33:17.509099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 32/58] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:33:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 6194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:33:17.513247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d22c3206-21df-479b-9bb3-4a41338604f1 req-f41b4131-a1b8-4b71-8cd5-2b0171771f50 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.514269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d22c3206-21df-479b-9bb3-4a41338604f1 req-f41b4131-a1b8-4b71-8cd5-2b0171771f50 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.514269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d22c3206-21df-479b-9bb3-4a41338604f1 req-f41b4131-a1b8-4b71-8cd5-2b0171771f50 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.515319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.516526 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.544444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.545311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.554259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.555873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.556798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.557605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.576692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-d22c3206-21df-479b-9bb3-4a41338604f1 req-f41b4131-a1b8-4b71-8cd5-2b0171771f50 service nova] Creating event network-changed:27e0b2b9-5ea2-4134-9705-162b267717ae for instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 on hv-cinder-85426 Aug 24 03:33:17.590495 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d22c3206-21df-479b-9bb3-4a41338604f1 req-f41b4131-a1b8-4b71-8cd5-2b0171771f50 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127258) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:33:17.591516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d22c3206-21df-479b-9bb3-4a41338604f1 req-f41b4131-a1b8-4b71-8cd5-2b0171771f50 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127258) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:33:17.594850 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.595850 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.598220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.603625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.607951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.609635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.686064 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.compute.rpcapi [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:33:17.698643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] Releasing lock "compute-rpcapi-router" {{(pid=127258) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:33:17.794495 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-99f0b24b-7dd8-49fa-b3bc-daaa65d9d277 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.257753 Aug 24 03:33:17.800324 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 27/59] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:17.847095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.848358 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.889198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.890210 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.891187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.892540 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.893529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.894340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.133313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:18.147565 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b8b4bb04-e1b0-4edb-b9c9-1b71d480ed8b tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.647337 Aug 24 03:33:18.150296 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 33/60] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:18.161609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9e75a77e-974e-4c2e-880f-0c2e7acdc1cc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.162132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9e75a77e-974e-4c2e-880f-0c2e7acdc1cc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.582035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9e75a77e-974e-4c2e-880f-0c2e7acdc1cc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:18.602686 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9e75a77e-974e-4c2e-880f-0c2e7acdc1cc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1241 microversion: 2.1 time: 0.451048 Aug 24 03:33:18.605223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 34/61] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:18 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1241 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:18.622909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.633826 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.654163 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.665483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.667112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.672698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.676277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.682507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.842422 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:18.882879 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3c038564-a905-42a2-bb50-c9d73b351e67 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 1.068984 Aug 24 03:33:18.903432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 28/62] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:19.084425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.105551 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.110341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.125323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e03c3b6d-9782-4564-8e64-c1e5e44971db tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1339 microversion: 2.20 time: 0.509050 Aug 24 03:33:19.129621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 35/63] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:18 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1339 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:19.198082 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:19.199147 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:19.213762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.214457 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.215192 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.217038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.220834 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.221364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.658040 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:19.659564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:19.683888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.684407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.684853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.685931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.689136 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.692970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.004334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:20.017758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bf2ea2aa-56cf-42b9-92ed-157ef2dccdf8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.827311 Aug 24 03:33:20.019173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 29/64] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:19 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:20.041802 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:20.043340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:20.085574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.086572 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.087350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.088370 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.090911 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.095868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.195477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:20.214028 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ee156c64-b538-4886-ada9-ed95dddc4916 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1237 microversion: 2.1 time: 0.571426 Aug 24 03:33:20.221595 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 36/65] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:19 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1237 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:20.237618 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:20.240889 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:20.257886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.262206 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.265633 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.267675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.268554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.271670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.699233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:20.715734 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:20.752609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:20.757379 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-723edd93-dd21-40dd-bc77-24a4e06376cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1339 microversion: 2.20 time: 0.531357 Aug 24 03:33:20.759615 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 37/66] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:20 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1339 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:21.043548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:21.044511 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:21.069327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.070599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.074638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.082040 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.116464 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.122748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.318532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:21.359338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-be5aa141-2dbd-4947-b501-91246051709e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 1.322229 Aug 24 03:33:21.364025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 30/67] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:20 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:21.377098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:21.384373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:21.409337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.418357 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.419592 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.421248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.426950 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.428137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.669126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:21.705147 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-74f27a29-9195-4794-b839-99ba0668406d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1237 microversion: 2.1 time: 0.336637 Aug 24 03:33:21.707493 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 31/68] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:21 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1237 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:21.801289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:21.803513 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:21.821290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.825997 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.827631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.828808 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.829519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.831058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.935797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:21.961581 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2e135698-b0e7-46d9-a8c2-a69bd8129fd5 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.920658 Aug 24 03:33:21.962872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 38/69] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:21 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:22.235862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=26 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:22.403099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:22.403954 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:22.411710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.412518 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.413172 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.414133 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.414799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.415408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.441819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.452168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=63 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:22.460583 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.462267 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.466561 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a64167fd-07b8-4183-b496-42426d999c37 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.670909 Aug 24 03:33:22.467868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 32/70] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:21 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:22.738154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:22.739229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:22.743165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:22.749293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.750145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.750818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.751868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.752833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.753700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.148894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.162567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9098798f-7c29-4291-b6bf-f5e8321a984f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1293 microversion: 2.1 time: 0.436016 Aug 24 03:33:23.164841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 33/71] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:22 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1293 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:23.175040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:23.177371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:23.193366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.193869 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.194307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.199122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.205067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.205067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.215572 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.245647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c49d8ade-70e1-45ad-ab38-26d7bec48f3f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.846073 Aug 24 03:33:23.248300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 39/72] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:22 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:23.513262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:23.514045 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:23.527908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.528680 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.529270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.530138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.530784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.531350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.781790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.804440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6b01c4d6-0977-41f7-9173-2efc75725541 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.636918 Aug 24 03:33:23.805624 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 34/73] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:23 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:24.026992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.042167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.048160 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.050831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9fe882d6-42fd-434d-ae49-0be50a07dcb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.541685 Aug 24 03:33:24.054070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 40/74] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:23 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:24.202611 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:24.203946 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:24.217419 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.218190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.218937 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.221095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.222032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.223206 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.287128 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:24.288896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:24.299805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.302032 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.302840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.305937 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.306785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.308640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.352352 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.365641 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d5f535e7-6d27-4aa1-b23c-a7fcec8e3ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1301 microversion: 2.1 time: 0.165120 Aug 24 03:33:24.368489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 35/75] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:24 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1301 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:24.554503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.567623 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-342325ff-7995-4555-83fe-c03f5735d05e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.286810 Aug 24 03:33:24.583674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 41/76] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:24 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:24.827793 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:24.829701 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:24.839372 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.840262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.840911 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.842514 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.843273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.854538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-c350ccdc-01cc-49b2-94ef-6b653146722a req-afd69a13-75b8-4134-ae2c-f1254a8a60cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d705a9b-3c26-4e94-b89e-a23a4c38320d", "tag": "2f066fe2-d5fc-4112-8e50-0029970924ff"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:24.862133 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.881114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c350ccdc-01cc-49b2-94ef-6b653146722a req-afd69a13-75b8-4134-ae2c-f1254a8a60cb service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.886683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c350ccdc-01cc-49b2-94ef-6b653146722a req-afd69a13-75b8-4134-ae2c-f1254a8a60cb service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.887255 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c350ccdc-01cc-49b2-94ef-6b653146722a req-afd69a13-75b8-4134-ae2c-f1254a8a60cb service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.909336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-c350ccdc-01cc-49b2-94ef-6b653146722a req-afd69a13-75b8-4134-ae2c-f1254a8a60cb service nova] Creating event network-changed:2f066fe2-d5fc-4112-8e50-0029970924ff for instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d on hv-cinder-85426 Aug 24 03:33:24.917776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-c350ccdc-01cc-49b2-94ef-6b653146722a req-afd69a13-75b8-4134-ae2c-f1254a8a60cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510857 Aug 24 03:33:24.923440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 36/77] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:24.936854 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-da9c3151-6bbb-4df6-a5e3-f83640a2e68a req-b55482d3-c794-467f-9a7b-9f801b9287ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaca649f-ad0a-4355-b741-7e46388c74cd", "tag": "f8a2d888-1c8d-4395-a171-9a83d1745a85"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:24.956168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-da9c3151-6bbb-4df6-a5e3-f83640a2e68a req-b55482d3-c794-467f-9a7b-9f801b9287ab service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.957654 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-da9c3151-6bbb-4df6-a5e3-f83640a2e68a req-b55482d3-c794-467f-9a7b-9f801b9287ab service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.959269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-da9c3151-6bbb-4df6-a5e3-f83640a2e68a req-b55482d3-c794-467f-9a7b-9f801b9287ab service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.983649 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-da9c3151-6bbb-4df6-a5e3-f83640a2e68a req-b55482d3-c794-467f-9a7b-9f801b9287ab service nova] Creating event network-changed:f8a2d888-1c8d-4395-a171-9a83d1745a85 for instance aaca649f-ad0a-4355-b741-7e46388c74cd on hv-cinder-85426 Aug 24 03:33:24.994205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-da9c3151-6bbb-4df6-a5e3-f83640a2e68a req-b55482d3-c794-467f-9a7b-9f801b9287ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068606 Aug 24 03:33:24.997391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 37/78] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:25.085934 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.086700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:25.089167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:25.098890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-120a71f0-f3bc-4923-85be-d9e7ce670083 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.276182 Aug 24 03:33:25.099951 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 42/79] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:24 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:25.126554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.127851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.129206 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.130801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.131930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.132701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.326598 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.345391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.349281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.351931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-323bda27-d6b5-4947-95a5-bdfd1d644134 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.276157 Aug 24 03:33:25.369820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 38/80] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:25 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:25.392190 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:25.393670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:25.402192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.404488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.404488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.404488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.405005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.405751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.519415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.538500 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7dcc5327-167b-4967-8ee2-e5943bce7112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1301 microversion: 2.1 time: 0.151035 Aug 24 03:33:25.540685 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 43/81] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:25 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1301 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:25.605940 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:25.607088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:25.620929 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.621554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.622019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.623168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.623646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.624083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.848661 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.862961 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-19f12084-311f-4b9d-9ca8-9c934582382b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.270779 Aug 24 03:33:25.864795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 39/82] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:25 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:26.139592 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.140273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.147187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.147702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.148095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.148813 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.149264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.149681 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.155807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:26.403196 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.403196 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.415470 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.434894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.435787 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.436546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.437794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ffcc8b94-54e0-4cbd-86e5-ad660b1e0788 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.301701 Aug 24 03:33:26.439377 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.439883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 44/83] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:26.440468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.441130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.579401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.585442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.628054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.629586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.632541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.634082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.635308 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.636542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.673098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.711299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.717327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.720539 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5b3206f1-f7ce-4055-816d-82ff234c1ba6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.325827 Aug 24 03:33:26.725125 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 40/84] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:26.775156 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.791891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8fe47548-0d3b-4e6e-b1a3-e70dc9eecdb3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1301 microversion: 2.1 time: 0.219497 Aug 24 03:33:26.807475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 45/85] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1301 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:26.904619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.910190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.935829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.942992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.947165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.950755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.956281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.958890 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.455809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.478867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-59aa1429-e48b-4262-9f85-abd0ecb86c6c tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.583855 Aug 24 03:33:27.479477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 41/86] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:27.480214 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.481448 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.513056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:27.521723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.522595 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.523408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.532845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.533672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.534420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.767333 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.768074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.780832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=8 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:27.785992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.788025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.789581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.792051 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.793230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.794514 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.091993 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.119015 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f81d290a-5ca7-4476-8c39-03a7734edd20 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.646656 Aug 24 03:33:28.131950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 46/87] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:28.151740 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:28.152804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:28.170605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.171808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.172499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.173444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.176237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.177061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.262770 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.302411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.314361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.319028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6d5fb3c9-0af9-43d5-a55e-c91bd596952a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.556520 Aug 24 03:33:28.334748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 42/88] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:28.396440 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.417187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-23fa241f-4a92-4d61-beb8-a2edc68df178 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1299 microversion: 2.1 time: 0.283612 Aug 24 03:33:28.433569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 47/89] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:28 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1299 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:28.506693 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:28.506693 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:28.527260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.528130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.528911 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.530210 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.531097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.532316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.833519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.848137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-44b2bd17-efea-4f2e-8c67-4565b4fe1637 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.350647 Aug 24 03:33:28.848860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 43/90] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:28 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:29.156196 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:29.160127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.189912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=8 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:29.195181 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.202539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.203890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.205152 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.206911 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.207930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.359086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:29.359809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.375484 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.376077 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.376670 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.377459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.380644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.381435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.739606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:29.770386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cb443f2d-d4e2-4459-a071-e6c53403ac67 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.624480 Aug 24 03:33:29.775185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 48/91] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:29 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:29.799037 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:29.800252 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.821536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.823622 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.824163 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.824913 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.825377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.825800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.877259 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:29.890334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:29.900911 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:29.902955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4891e9c6-9538-475a-beb6-479a37197802 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.548894 Aug 24 03:33:29.913845 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 44/92] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:29 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:29.922286 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:29.923340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.936593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.938610 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.940159 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.941363 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.946854 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.947653 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.135485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:30.150482 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0332ede4-56fc-4d35-9b74-6866855959a3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.372365 Aug 24 03:33:30.151921 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 49/93] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:29 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:30.369818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:30.380983 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8a81cc3f-19b2-4a77-9e0a-946e5179f4c7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.465280 Aug 24 03:33:30.385966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 45/94] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:29 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:30.808639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:30.809838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:30.848021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:30.849552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.855789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.861818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:30.875792 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.876244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.927476 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:30.928277 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:30.943190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:30.943190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.943190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.943838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:30.943838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.944243 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.759374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:31.802045 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:31.805426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:31.826319 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-00842e29-632b-45d3-8c32-7408ca9ec05c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.899115 Aug 24 03:33:31.831618 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 46/95] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:30 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:31.856257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:31.867529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:31.871627 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:31.889226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f1773069-9c1f-4b98-a060-0c7d61542070 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 1.093958 Aug 24 03:33:31.894224 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 50/96] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:30 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:31.899100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.902205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.903049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.906990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.907944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.908736 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.917447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:31.918589 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:31.946342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.947286 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.948066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.949353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.950177 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.951745 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.423553 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:32.432890 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:32.454987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2ef7f2be-3ab7-44fe-b606-cc27864cb549 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.539360 Aug 24 03:33:32.454987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 51/97] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:31 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:32.477578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cf58d347-1f7f-4221-9aca-0f9588311e5f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.644444 Aug 24 03:33:32.478588 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 47/98] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:31 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:32.626900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-9a8ebee2-657a-4b0d-8985-203c0a2b408f req-b66dd1db-fe3b-4a3c-bf22-b6f9182af48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcdb504-ee37-415b-9a1c-60efdf7b3c82", "name": "network-vif-plugged", "status": "completed", "tag": "27e0b2b9-5ea2-4134-9705-162b267717ae"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:32.654370 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9a8ebee2-657a-4b0d-8985-203c0a2b408f req-b66dd1db-fe3b-4a3c-bf22-b6f9182af48a service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:32.654810 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9a8ebee2-657a-4b0d-8985-203c0a2b408f req-b66dd1db-fe3b-4a3c-bf22-b6f9182af48a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:32.655252 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9a8ebee2-657a-4b0d-8985-203c0a2b408f req-b66dd1db-fe3b-4a3c-bf22-b6f9182af48a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.734742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-9a8ebee2-657a-4b0d-8985-203c0a2b408f req-b66dd1db-fe3b-4a3c-bf22-b6f9182af48a service nova] Creating event network-vif-plugged:27e0b2b9-5ea2-4134-9705-162b267717ae for instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 on hv-cinder-85426 Aug 24 03:33:32.735377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9a8ebee2-657a-4b0d-8985-203c0a2b408f req-b66dd1db-fe3b-4a3c-bf22-b6f9182af48a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:33:32.737349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9a8ebee2-657a-4b0d-8985-203c0a2b408f req-b66dd1db-fe3b-4a3c-bf22-b6f9182af48a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:33:32.738906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:32.739822 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:32.739962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.741337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:32.741888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:32.742321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.780590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.compute.rpcapi [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:33:32.781537 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] Releasing lock "compute-rpcapi-router" {{(pid=127257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:33:32.808431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f464abf8-6847-431b-b952-4b94eeed6693 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367597 Aug 24 03:33:32.813318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 52/99] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:32.868179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:32.868919 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:32.896876 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:32.897865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:32.898666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.901697 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:32.902505 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:32.903330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.961623 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:32.970396 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:33.006543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.007928 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.008981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.011423 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.014205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.017726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.449144 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.459995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.462277 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.469993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8143fb78-cd41-4545-b0a1-878afcc66acc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.607232 Aug 24 03:33:33.473782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.487630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 48/100] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:32 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:33.493001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-43d0b07f-efc2-4f49-be42-6a2867d09fbf tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.576549 Aug 24 03:33:33.509631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 53/101] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:32 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:33.516936 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-40619b74-b4bf-4479-aa77-5a3fba326833 req-ba3acfef-1e5c-48f3-800d-16558c654f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ee23ad-01a0-4e1a-bef2-7b0d4019fbda", "tag": "e6d7b44d-dba1-4857-9a24-2d8268f49c17"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:33.530065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:33.532259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:33.550441 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.551243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.552861 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.557019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.559443 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-40619b74-b4bf-4479-aa77-5a3fba326833 req-ba3acfef-1e5c-48f3-800d-16558c654f30 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.559901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.560096 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-40619b74-b4bf-4479-aa77-5a3fba326833 req-ba3acfef-1e5c-48f3-800d-16558c654f30 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.560361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-40619b74-b4bf-4479-aa77-5a3fba326833 req-ba3acfef-1e5c-48f3-800d-16558c654f30 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.577305 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.592395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-40619b74-b4bf-4479-aa77-5a3fba326833 req-ba3acfef-1e5c-48f3-800d-16558c654f30 service nova] Creating event network-changed:e6d7b44d-dba1-4857-9a24-2d8268f49c17 for instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda on hv-cinder-85426 Aug 24 03:33:33.612472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-40619b74-b4bf-4479-aa77-5a3fba326833 req-ba3acfef-1e5c-48f3-800d-16558c654f30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121727 Aug 24 03:33:33.621923 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 49/102] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:33.643537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:33.644589 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:33.672643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.673248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.673805 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.674785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.680547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.683782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.274549 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.284689 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0fd48374-28f6-4b54-b8b1-63250af84b7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.767972 Aug 24 03:33:34.291840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.302283 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 54/103] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:33 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:34.310987 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2ab94ac3-215a-4c67-9246-d7625fdf5a36 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.685542 Aug 24 03:33:34.313348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 50/104] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:33 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:34.527239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:34.530132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:34.537039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:34.537919 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:34.539853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.541521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.542692 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.544691 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.545832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.546802 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.548194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.548689 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.549124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.549856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.550289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.552961 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.579310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:34.916251 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.930690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.941449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a7354d5e-447a-4f22-a28f-d7a271652d63 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.426881 Aug 24 03:33:34.944112 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.945666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.946859 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-af8c8acc-90f6-44cb-99a5-69c67b26c745 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.415009 Aug 24 03:33:34.947779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 51/105] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:34 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:34.948502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 55/106] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:34 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:35.312757 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:35.317600 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:35.340130 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:35.341169 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:35.365944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.366823 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.367703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.368255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.368612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.369560 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.370228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.370904 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.378149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.380757 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.381808 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.391669 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.024053 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.091014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-25f0a560-d011-4d70-a83b-a1874d2c0fc4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.786779 Aug 24 03:33:36.124458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 52/107] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:35 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:36.136293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:36.137976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.138424 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:36.150164 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.151623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.152663 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.154730 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.156114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.159542 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.193919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-99f198c9-2fe7-43de-a06d-09b8583010ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.862024 Aug 24 03:33:36.204108 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 56/108] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:35 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:36.221207 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:36.244893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:36.280540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.281684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.282782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.284743 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.286247 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.303023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.882005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.908716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.916253 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.920044 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.922621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-af97f9ca-42a6-443f-8736-06c2e51edc1e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.716107 Aug 24 03:33:36.924117 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 57/109] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:36 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:36.928052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9dd1bede-79e8-41b8-98fd-472f5e7b2759 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.798848 Aug 24 03:33:36.942692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 53/110] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:36 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:36.942973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-e035fb06-b32b-4c23-af29-0904a7921a91 req-42d8895c-640f-414d-9f56-6f84dfcf509e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d705a9b-3c26-4e94-b89e-a23a4c38320d", "name": "network-vif-plugged", "status": "completed", "tag": "2f066fe2-d5fc-4112-8e50-0029970924ff"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:36.945583 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-e035fb06-b32b-4c23-af29-0904a7921a91 req-42d8895c-640f-414d-9f56-6f84dfcf509e service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.946069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-e035fb06-b32b-4c23-af29-0904a7921a91 req-42d8895c-640f-414d-9f56-6f84dfcf509e service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.946505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-e035fb06-b32b-4c23-af29-0904a7921a91 req-42d8895c-640f-414d-9f56-6f84dfcf509e service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.962772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-e035fb06-b32b-4c23-af29-0904a7921a91 req-42d8895c-640f-414d-9f56-6f84dfcf509e service nova] Creating event network-vif-plugged:2f066fe2-d5fc-4112-8e50-0029970924ff for instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d on hv-cinder-85426 Aug 24 03:33:36.969377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-e035fb06-b32b-4c23-af29-0904a7921a91 req-42d8895c-640f-414d-9f56-6f84dfcf509e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043867 Aug 24 03:33:36.970318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 58/111] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:37.132318 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:37.133594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:37.141884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.151228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.152072 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.153147 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.153922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.155664 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.241104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:37.241873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:37.277364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.277973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.278826 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.279838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.281044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.282118 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.702249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:37.712284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:37.724599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-64d81654-e5b7-4fc1-833c-d1f671ef5197 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.595888 Aug 24 03:33:37.728076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 54/112] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:37 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:37.757854 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f1d1d164-e638-442d-9adf-8f6616964943 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.526547 Aug 24 03:33:37.763718 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 59/113] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:37 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:37.965167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:37.968024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:37.969466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:37.970582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:37.993649 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.994569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.995386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.997013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.997900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.998487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.999518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.000280 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.001069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.001763 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.002668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.003352 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.488684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.507559 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b0543e0f-003b-42e6-99a2-6fed68eff438 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1314 microversion: 2.1 time: 0.552175 Aug 24 03:33:38.521097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 55/114] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:37 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:38.529636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.563830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.570696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.588446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-94ac3652-eaa9-4a1e-b7af-1a3c7cd8b92f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.624077 Aug 24 03:33:38.591725 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 60/115] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:37 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:38.763789 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:38.765437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.798861 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:38.799916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.813069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.815434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.817220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.819406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.820476 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.821598 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.825159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.825915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.826639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.829925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.831131 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.838166 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.348477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:39.356698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:39.363089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:39.373255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4bec4da0-2f05-4405-b1c5-3129481720ab tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.581748 Aug 24 03:33:39.374976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 61/116] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:38 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:39.385004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-a28b4e3e-2799-4d15-b4ae-f74302866850 req-cbdcda13-66f2-4258-9c63-e848bb39d256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaca649f-ad0a-4355-b741-7e46388c74cd", "name": "network-vif-plugged", "status": "completed", "tag": "f8a2d888-1c8d-4395-a171-9a83d1745a85"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:39.385404 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-613ee158-6c88-4615-8293-d3002f89cc50 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1364 microversion: 2.1 time: 0.633823 Aug 24 03:33:39.390207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 56/117] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:38 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1364 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:39.411664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a28b4e3e-2799-4d15-b4ae-f74302866850 req-cbdcda13-66f2-4258-9c63-e848bb39d256 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:39.412856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a28b4e3e-2799-4d15-b4ae-f74302866850 req-cbdcda13-66f2-4258-9c63-e848bb39d256 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:39.413660 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a28b4e3e-2799-4d15-b4ae-f74302866850 req-cbdcda13-66f2-4258-9c63-e848bb39d256 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.453992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-a28b4e3e-2799-4d15-b4ae-f74302866850 req-cbdcda13-66f2-4258-9c63-e848bb39d256 service nova] Creating event network-vif-plugged:f8a2d888-1c8d-4395-a171-9a83d1745a85 for instance aaca649f-ad0a-4355-b741-7e46388c74cd on hv-cinder-85426 Aug 24 03:33:39.464299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-a28b4e3e-2799-4d15-b4ae-f74302866850 req-cbdcda13-66f2-4258-9c63-e848bb39d256 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087108 Aug 24 03:33:39.472639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 62/118] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:39.546911 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:39.548067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:39.565732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:39.567403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:39.568388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.569777 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:39.571094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:39.572026 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.647499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:39.648587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:39.658041 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:39.658985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:39.659705 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.660773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:39.661802 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:39.662473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.073628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.107221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.114617 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.121708 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-289f743b-78d0-4280-840d-68c2837806fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.480163 Aug 24 03:33:40.125544 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 63/119] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:39 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:40.203763 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.219055 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4144c043-6fa0-43fb-9b35-9d352873893e tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1501 microversion: 2.1 time: 0.679704 Aug 24 03:33:40.233313 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 57/120] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:39 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1501 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:40.415511 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:40.416555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:40.419519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:40.423111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:40.436299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.437560 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.439259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.440597 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.441514 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.442258 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.449952 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.455937 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.458808 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.464463 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.465766 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.469302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.985027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.016345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6b0540fc-349a-40ba-9352-b6a35a0a294b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.609602 Aug 24 03:33:41.018883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 64/121] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:40 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:41.028744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.054820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e69dc68a-562c-4200-86b7-235b4c27ad75 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1549 microversion: 2.1 time: 0.642069 Aug 24 03:33:41.069269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 58/122] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:40 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1549 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:41.104178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:41.108505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:41.125632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:41.129896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.131247 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.132404 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.134201 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.135387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.138170 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.166328 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:41.171343 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:41.201074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.202248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.203202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.204662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.205648 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.207117 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.460193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d22937dd-e036-43af-9eca-9d0b0d349cb4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.381227 Aug 24 03:33:41.461532 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 65/123] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:33:41 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-interface => generated 284 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:41.530591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.548614 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.551971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.554211 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d832b376-8cde-414a-bb92-83afb866d590 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.399765 Aug 24 03:33:41.573550 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 59/124] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:41 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:42.062489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:42.068992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:42.087624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.092010 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.097212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.100195 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.104700 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.105596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61cc5993-ef74-436d-b876-7a6135970eb0"}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:42.107202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.109449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:42.118104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.119105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.119844 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.120787 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.121466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.122178 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.598817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.624954 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d455f106-2592-40c2-8627-9bcb5d4091c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.573960 Aug 24 03:33:42.625933 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 66/125] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:42 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:42.638397 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:42.639422 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:42.647945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.648755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.649437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.650439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.651218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.651901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.779659 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:42.890150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.915048 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.921276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.924402 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ce0ba020-3461-4c24-83f9-8ed1f065f318 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.295247 Aug 24 03:33:42.926960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 67/126] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:42 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:43.649420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:43.651007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:43.661820 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:43.663029 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:43.663821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:43.664957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:43.665698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:43.666333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:43.744509 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c1185686-3c50-450c-9006-1479d9d780d9 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "POST /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.642401 Aug 24 03:33:43.764013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 60/127] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:33:42 2022] POST /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82/os-volume_attachments => generated 194 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:43.959330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:43.973338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:44.015194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.015982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.027403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.028709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.029619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.030274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.282516 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:44.306372 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a038a470-bda9-4bab-9a8d-7805ed7fb492 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.663112 Aug 24 03:33:44.318275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 68/128] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:43 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:44.634132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-215ee89c-2bb7-47e9-a99c-41b5c18a9258 req-3b68fa66-0a81-4ef8-91f9-1ded5a9ac1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d705a9b-3c26-4e94-b89e-a23a4c38320d", "tag": "2f066fe2-d5fc-4112-8e50-0029970924ff"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:44.655092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-215ee89c-2bb7-47e9-a99c-41b5c18a9258 req-3b68fa66-0a81-4ef8-91f9-1ded5a9ac1c1 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.656076 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-215ee89c-2bb7-47e9-a99c-41b5c18a9258 req-3b68fa66-0a81-4ef8-91f9-1ded5a9ac1c1 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.656900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-215ee89c-2bb7-47e9-a99c-41b5c18a9258 req-3b68fa66-0a81-4ef8-91f9-1ded5a9ac1c1 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.684754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-215ee89c-2bb7-47e9-a99c-41b5c18a9258 req-3b68fa66-0a81-4ef8-91f9-1ded5a9ac1c1 service nova] Creating event network-changed:2f066fe2-d5fc-4112-8e50-0029970924ff for instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d on hv-cinder-85426 Aug 24 03:33:44.707863 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-215ee89c-2bb7-47e9-a99c-41b5c18a9258 req-3b68fa66-0a81-4ef8-91f9-1ded5a9ac1c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076522 Aug 24 03:33:44.713788 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 69/129] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:44.733762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:44.743901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:44.746274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:44.747718 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-62b48629-014d-4853-bad9-c8ff9edfea93 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.797023 Aug 24 03:33:44.749077 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 61/130] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:43 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:45.363951 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:45.364876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:45.377725 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:45.378234 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:45.379059 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:45.380003 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:45.380629 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:45.383842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:45.782865 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:45.789668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:45.791888 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:45.813938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-22d3f238-434c-45e2-aff1-965455f5fce5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.451926 Aug 24 03:33:45.816153 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 70/131] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:45 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:45.816838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:45.818528 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:45.821588 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:45.824872 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:45.826316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:45.827860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:46.120706 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:46.141984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:46.146966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:46.149656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9dc52cfe-81f8-4331-aa2e-9028ca7d1fce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1407 microversion: 2.20 time: 0.371266 Aug 24 03:33:46.151552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 62/132] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:45 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:46.841670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:46.842317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:46.854309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:46.854860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:46.861581 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:46.862352 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:46.862868 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:46.863760 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.083222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.100002 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-16567cee-f2c3-4d32-9068-78e08bfe3850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.261667 Aug 24 03:33:47.100950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 71/133] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:46 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:47.178880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:47.179726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:47.194645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.195493 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.196263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.197514 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.198619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.199809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.458449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-72047a4d-e6ed-46e8-b6f8-14f990e2de02 req-6985ac42-00dc-4fb1-90bc-d95cc6feaa34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ee23ad-01a0-4e1a-bef2-7b0d4019fbda", "name": "network-vif-plugged", "status": "completed", "tag": "e6d7b44d-dba1-4857-9a24-2d8268f49c17"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:47.499713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-72047a4d-e6ed-46e8-b6f8-14f990e2de02 req-6985ac42-00dc-4fb1-90bc-d95cc6feaa34 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.500488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-72047a4d-e6ed-46e8-b6f8-14f990e2de02 req-6985ac42-00dc-4fb1-90bc-d95cc6feaa34 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.502511 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-72047a4d-e6ed-46e8-b6f8-14f990e2de02 req-6985ac42-00dc-4fb1-90bc-d95cc6feaa34 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.556811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-72047a4d-e6ed-46e8-b6f8-14f990e2de02 req-6985ac42-00dc-4fb1-90bc-d95cc6feaa34 service nova] Creating event network-vif-plugged:e6d7b44d-dba1-4857-9a24-2d8268f49c17 for instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda on hv-cinder-85426 Aug 24 03:33:47.600998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-72047a4d-e6ed-46e8-b6f8-14f990e2de02 req-6985ac42-00dc-4fb1-90bc-d95cc6feaa34 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145996 Aug 24 03:33:47.603475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 72/134] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:47.645994 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.666371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.672021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.676920 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8718fdd3-ce96-42c0-9326-5d74d119cb60 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1599 microversion: 2.20 time: 0.502690 Aug 24 03:33:47.682099 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 63/135] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:47 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1599 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:47.718333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:47.719678 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:47.749477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.750407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.751092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.751932 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.752809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.755756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:48.070774 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1ccd0f63-4dea-4e32-91cb-e5fb7f7297bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.366210 Aug 24 03:33:48.072273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 73/136] 10.222.0.78 () {60 vars in 1316 bytes} [Wed Aug 24 03:33:47 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-interface => generated 285 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:33:48.149241 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:48.151446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:48.167258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:48.168217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:48.169288 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:48.170695 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:48.173023 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:48.175397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:48.475667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:48.493030 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-35ad84bb-fb5f-41f9-a1e7-4fbb0c971794 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.355614 Aug 24 03:33:48.506847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 64/137] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:48 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:49.127279 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:49.129373 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:49.151010 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.152768 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.153717 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.156987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.158588 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.159670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.237438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:49.439971 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-eb458373-3666-4b16-ab35-36f38ebeabfd tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 204 len: 0 microversion: 2.1 time: 0.319772 Aug 24 03:33:49.442831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 74/138] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:49 2022] DELETE /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:33:49.465264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:49.467052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:49.481802 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.485412 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.486824 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.488331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.489437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.490836 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.522905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:49.523856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:49.540807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.541458 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.541938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.542803 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.543434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.543956 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:50.491280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:50.529196 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:50.541383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3083da10-df25-49be-b0a2-ce6f9074b873 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1553 microversion: 2.1 time: 1.090862 Aug 24 03:33:50.543679 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 65/139] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:49 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1553 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:50.559161 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dd8cef86-67e8-439b-a06d-5666ca1b18bd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 1.040859 Aug 24 03:33:50.560181 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 75/140] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:49 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:51.269746 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-45887f36-7e12-46ac-aefb-e8371eb6b3c9 req-b056d5ba-8460-4d68-99d6-63d12daf8734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaca649f-ad0a-4355-b741-7e46388c74cd", "tag": "f8a2d888-1c8d-4395-a171-9a83d1745a85"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:51.290884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-45887f36-7e12-46ac-aefb-e8371eb6b3c9 req-b056d5ba-8460-4d68-99d6-63d12daf8734 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.292172 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-45887f36-7e12-46ac-aefb-e8371eb6b3c9 req-b056d5ba-8460-4d68-99d6-63d12daf8734 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.292980 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-45887f36-7e12-46ac-aefb-e8371eb6b3c9 req-b056d5ba-8460-4d68-99d6-63d12daf8734 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.318747 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-45887f36-7e12-46ac-aefb-e8371eb6b3c9 req-b056d5ba-8460-4d68-99d6-63d12daf8734 service nova] Creating event network-changed:f8a2d888-1c8d-4395-a171-9a83d1745a85 for instance aaca649f-ad0a-4355-b741-7e46388c74cd on hv-cinder-85426 Aug 24 03:33:51.333685 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-45887f36-7e12-46ac-aefb-e8371eb6b3c9 req-b056d5ba-8460-4d68-99d6-63d12daf8734 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069777 Aug 24 03:33:51.335833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 66/141] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:51.596767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:51.598028 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:51.608118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:51.609249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:51.621485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.622106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.622563 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.623467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.623970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.624442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.681178 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.682025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.682811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.684053 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.684880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.685616 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.782524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:52.197044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:52.211232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-880170e8-7a62-47a0-9b47-f29d7c7f6a71 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1553 microversion: 2.1 time: 0.634431 Aug 24 03:33:52.230205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 76/142] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:51 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1553 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:52.257036 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:52.276335 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3e118358-6b7b-453a-937a-6b419e349d87 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1367 microversion: 2.1 time: 0.675693 Aug 24 03:33:52.287501 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 67/143] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:51 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1367 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:53.240428 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:53.241617 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:53.259720 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.260653 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.261472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.263504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.264879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.266787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.330015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:53.337080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:53.394906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=70 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:53.406689 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.407656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.414853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.416405 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.418172 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.429856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.876067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:53.897307 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:53.917129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ec2a0502-20a9-4f41-acf6-0f54ebf7ddc1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1556 microversion: 2.1 time: 0.599993 Aug 24 03:33:53.921917 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-bb58c91e-d980-432a-b491-9653b8cfb286 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1553 microversion: 2.1 time: 0.690132 Aug 24 03:33:53.936039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 68/144] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:53 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1556 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:53.939094 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 77/145] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:53 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1553 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:53.976942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:53.979581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:54.007111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:54.007870 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:54.008551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:54.010222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:54.010844 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:54.011372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:54.272895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-aa0d5b46-20c2-4f86-8816-3db8bba60243 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.305433 Aug 24 03:33:54.273988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 69/146] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:33:53 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-interface => generated 284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:54.367196 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1649986667", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "networks": [{"uuid": "9881b092-ecf0-4049-91cb-a639dc282d78"}]}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:54.453394 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] validate_networks() for [('9881b092-ecf0-4049-91cb-a639dc282d78', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:33:54.977534 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:54.984829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:55.021518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:55.023265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:55.025867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:55.028428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:55.032967 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:55.034872 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:55.959926 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:55.977789 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-85ba8ba2-7b02-407e-8573-fb8a946562a3 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1553 microversion: 2.1 time: 1.018392 Aug 24 03:33:55.978984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 70/147] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:54 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1553 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:56.280827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-ebbb9d09-dee0-4c29-af5e-5e1dce3fa51a req-b727289f-fc96-4d2c-84a7-e35a47895b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcdb504-ee37-415b-9a1c-60efdf7b3c82", "name": "network-vif-deleted", "tag": "27e0b2b9-5ea2-4134-9705-162b267717ae"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:56.304215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-ebbb9d09-dee0-4c29-af5e-5e1dce3fa51a req-b727289f-fc96-4d2c-84a7-e35a47895b7a service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:56.304991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-ebbb9d09-dee0-4c29-af5e-5e1dce3fa51a req-b727289f-fc96-4d2c-84a7-e35a47895b7a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:56.305944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-ebbb9d09-dee0-4c29-af5e-5e1dce3fa51a req-b727289f-fc96-4d2c-84a7-e35a47895b7a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:56.332807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-ebbb9d09-dee0-4c29-af5e-5e1dce3fa51a req-b727289f-fc96-4d2c-84a7-e35a47895b7a service nova] Creating event network-vif-deleted:27e0b2b9-5ea2-4134-9705-162b267717ae for instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 on hv-cinder-85426 Aug 24 03:33:56.344922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-ebbb9d09-dee0-4c29-af5e-5e1dce3fa51a req-b727289f-fc96-4d2c-84a7-e35a47895b7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100347 Aug 24 03:33:56.350070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 71/148] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:57.016221 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:57.017667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:57.030272 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.031171 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.031975 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.033389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.034361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.035342 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.099657 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.100585 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.101261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.102387 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lazy-loading 'fault' on Instance uuid 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:57.324158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8969ad404a44181b719c5546230c49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c423ab6ae8843d0a65df1f706a3c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:57.352372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8f573418-f6d7-4d50-9cab-abc13473b9e8 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 200 len: 1350 microversion: 2.1 time: 0.343859 Aug 24 03:33:57.354593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 72/149] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:57 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 1350 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:57.387297 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:33:57.389390 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:33:57.391055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:33:57.392072 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:33:57.393434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:33:57.413011 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.413942 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.414767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.416436 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.417368 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.418149 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.459775 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Getting quotas for project 30db6d523c5c4763933b86c160ea3d87. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:57.469100 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Getting quotas for user 3d824b7cad264484bde1071e4e6306ad and project 30db6d523c5c4763933b86c160ea3d87. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:57.494042 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:33:57.499727 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:33:57.641655 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-59432f0c-b790-4a55-9e08-0fdfc307f227 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.280119 Aug 24 03:33:57.643759 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 78/150] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:33:57.656126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1f326f4b-0ba4-4dd1-b5fb-2f5d29796aab tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:57.659633 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1f326f4b-0ba4-4dd1-b5fb-2f5d29796aab tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:57.795478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1f326f4b-0ba4-4dd1-b5fb-2f5d29796aab tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:57.818330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1f326f4b-0ba4-4dd1-b5fb-2f5d29796aab tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1214 microversion: 2.1 time: 0.163209 Aug 24 03:33:57.828297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 73/151] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:57 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:58.405183 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.407890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:58.423399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.424821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.426584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.429914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.431550 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.432655 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.466095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] HTTP exception thrown: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Request method failure captured: Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 HTTP/1.1 Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvjy4aMs6NsvSPzvBZPrJ4G8rXigmmitYTbN-ZbG37mTdOXQanAzxVnRrDy4Kxa82xj-peXbdx88xNz2HeUHQXAfD98jL4afWcY06V3k5z1zuuW4chRsO3M_w-kluWHVPM6YVVMqo7BLkQ_iEHm97da3_6mfmmmPt_i7CqMsPBmD5w Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:33:58.476804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c423ab6ae8843d0a65df1f706a3c41e"}]}] Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: c8969ad404a44181b719c5546230c49a Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.479908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '0fcdb504-ee37-415b-9a1c-60efdf7b3c82'} Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:58.481187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.483275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.491584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Returning 404 to user: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:58.491584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fbf5c21a-5a1e-4311-a70a-2b220199a801 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 404 len: 111 microversion: 2.1 time: 0.088934 Aug 24 03:33:58.491584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 79/152] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:58 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:58.722178 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.727005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:58.739416 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.740242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.740963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.742190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.743062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.744104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.779402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] HTTP exception thrown: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Request method failure captured: Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82/os-volume_attachments HTTP/1.1 Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvjy4aMs6NsvSPzvBZPrJ4G8rXigmmitYTbN-ZbG37mTdOXQanAzxVnRrDy4Kxa82xj-peXbdx88xNz2HeUHQXAfD98jL4afWcY06V3k5z1zuuW4chRsO3M_w-kluWHVPM6YVVMqo7BLkQ_iEHm97da3_6mfmmmPt_i7CqMsPBmD5w Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:33:58.785809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c423ab6ae8843d0a65df1f706a3c41e"}]}] Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: c8969ad404a44181b719c5546230c49a Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.787371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'server_id': '0fcdb504-ee37-415b-9a1c-60efdf7b3c82'} Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:58.788008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:33:58.789091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:33:58.792137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Returning 404 to user: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:58.793650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-159789e9-6252-4d98-b1c6-1dd9b972d519 tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.079126 Aug 24 03:33:58.811186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 74/153] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:33:58 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82/os-volume_attachments => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:58.851620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-9c12c2f3-fcd0-439d-b277-5844dcf7bff9 req-1da177e4-0646-4e3c-8a14-cba520bcfb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ee23ad-01a0-4e1a-bef2-7b0d4019fbda", "tag": "e6d7b44d-dba1-4857-9a24-2d8268f49c17"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:58.853029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.853908 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:58.868557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.869087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.872976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.874531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.877414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.879412 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.920613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9c12c2f3-fcd0-439d-b277-5844dcf7bff9 req-1da177e4-0646-4e3c-8a14-cba520bcfb9b service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.923188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9c12c2f3-fcd0-439d-b277-5844dcf7bff9 req-1da177e4-0646-4e3c-8a14-cba520bcfb9b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.923188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9c12c2f3-fcd0-439d-b277-5844dcf7bff9 req-1da177e4-0646-4e3c-8a14-cba520bcfb9b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.967730 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-9c12c2f3-fcd0-439d-b277-5844dcf7bff9 req-1da177e4-0646-4e3c-8a14-cba520bcfb9b service nova] Creating event network-changed:e6d7b44d-dba1-4857-9a24-2d8268f49c17 for instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda on hv-cinder-85426 Aug 24 03:33:58.976391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-9c12c2f3-fcd0-439d-b277-5844dcf7bff9 req-1da177e4-0646-4e3c-8a14-cba520bcfb9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134983 Aug 24 03:33:58.977825 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 80/154] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:59.041703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:59.137192 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1a8c4474-6a92-4379-b223-7e278c863911 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1218 microversion: 2.1 time: 0.289403 Aug 24 03:33:59.169516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 75/155] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:58 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1218 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:00.193884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.198285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:00.235363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.236362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.236981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.238512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.239399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.248101 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.350860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:00.391941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.393065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:00.428846 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.430205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.431736 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.435780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.438639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.441450 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.495468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] HTTP exception thrown: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Request method failure captured: Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: DELETE /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 HTTP/1.1 Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvjy4aMs6NsvSPzvBZPrJ4G8rXigmmitYTbN-ZbG37mTdOXQanAzxVnRrDy4Kxa82xj-peXbdx88xNz2HeUHQXAfD98jL4afWcY06V3k5z1zuuW4chRsO3M_w-kluWHVPM6YVVMqo7BLkQ_iEHm97da3_6mfmmmPt_i7CqMsPBmD5w Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:34:00.512472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c423ab6ae8843d0a65df1f706a3c41e"}]}] Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: c8969ad404a44181b719c5546230c49a Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.515158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '0fcdb504-ee37-415b-9a1c-60efdf7b3c82'} Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:00.516666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.519200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.533417 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Returning 404 to user: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:00.543675 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a77c103b-c716-4486-934e-1772c011beef tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 404 len: 111 microversion: 2.1 time: 0.167342 Aug 24 03:34:00.549555 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 76/156] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:00 2022] DELETE /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:00.572684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.578104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] [instance: 0fcdb504-ee37-415b-9a1c-60efdf7b3c82] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:00.608833 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:00.632701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.633775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.635121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.642133 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.643264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.646492 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.652152 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-98f1c0b3-7a7a-4568-8e67-4c5c5420d52f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1284 microversion: 2.1 time: 0.466290 Aug 24 03:34:00.668467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 81/157] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:00 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1284 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:00.710205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] HTTP exception thrown: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Request method failure captured: Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 HTTP/1.1 Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvjy4aMs6NsvSPzvBZPrJ4G8rXigmmitYTbN-ZbG37mTdOXQanAzxVnRrDy4Kxa82xj-peXbdx88xNz2HeUHQXAfD98jL4afWcY06V3k5z1zuuW4chRsO3M_w-kluWHVPM6YVVMqo7BLkQ_iEHm97da3_6mfmmmPt_i7CqMsPBmD5w Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:34:00.715302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9c423ab6ae8843d0a65df1f706a3c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9c423ab6ae8843d0a65df1f706a3c41e"}]}] Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 9c423ab6ae8843d0a65df1f706a3c41e Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755934269 Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: c8969ad404a44181b719c5546230c49a Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-DeleteServersTestJSON-1755934269-project Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.717683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '0fcdb504-ee37-415b-9a1c-60efdf7b3c82'} Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:00.720626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. Aug 24 03:34:00.726596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.737146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] Returning 404 to user: Instance 0fcdb504-ee37-415b-9a1c-60efdf7b3c82 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:00.737146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ec3dde50-0410-4363-b225-09f62093075a tempest-DeleteServersTestJSON-1755934269 tempest-DeleteServersTestJSON-1755934269-project] 10.222.0.78 "GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82" status: 404 len: 111 microversion: 2.1 time: 0.179531 Aug 24 03:34:00.739020 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 77/158] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:00 2022] GET /compute/v2.1/servers/0fcdb504-ee37-415b-9a1c-60efdf7b3c82 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:01.699129 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:01.700022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:01.727465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.742919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.751268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.755578 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.758512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.762900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.015981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:02.057581 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-eca90933-7700-4053-a3b0-20c05e565144 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1272 microversion: 2.1 time: 0.368437 Aug 24 03:34:02.070784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 82/159] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:01 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1272 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:03.099055 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:03.108558 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:03.131396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.132812 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.134186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.137371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.138387 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.140254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.563852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:03.590981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ec626109-adf1-43e2-9c08-cfb746e7c0a4 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.510031 Aug 24 03:34:03.606779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 78/160] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:03 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:03.946177 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-409f11ea-ad93-4c05-85aa-291570d8a3c8 req-59a8e2a5-a15e-4a61-9c48-293631955d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f96d2d-64e5-4ae5-9c84-63221a8435e9", "tag": "8d45ac02-61e6-499b-88bf-8447cce35fe3"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:03.964317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-409f11ea-ad93-4c05-85aa-291570d8a3c8 req-59a8e2a5-a15e-4a61-9c48-293631955d4a service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.965000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-409f11ea-ad93-4c05-85aa-291570d8a3c8 req-59a8e2a5-a15e-4a61-9c48-293631955d4a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.965615 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-409f11ea-ad93-4c05-85aa-291570d8a3c8 req-59a8e2a5-a15e-4a61-9c48-293631955d4a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.979945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-409f11ea-ad93-4c05-85aa-291570d8a3c8 req-59a8e2a5-a15e-4a61-9c48-293631955d4a service nova] Creating event network-changed:8d45ac02-61e6-499b-88bf-8447cce35fe3 for instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 on hv-cinder-85426 Aug 24 03:34:03.986557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-409f11ea-ad93-4c05-85aa-291570d8a3c8 req-59a8e2a5-a15e-4a61-9c48-293631955d4a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045780 Aug 24 03:34:03.987888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 83/161] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:04.639430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:04.644381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:04.670797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:04.673866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:04.679148 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:04.680820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:04.681933 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:04.685758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:05.044275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:05.060072 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5c7a0526-d922-4b57-b722-55ce36d83822 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.429017 Aug 24 03:34:05.061092 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 79/162] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:04 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:06.097921 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:06.099969 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:06.122020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.122535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.123060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.123821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.124309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.124742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.459307 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:06.476695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4ed2b059-e9df-4a75-9283-864e8da58310 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.385719 Aug 24 03:34:06.519610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 84/163] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:06 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:07.531759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:07.534781 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:07.560271 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.565202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.567314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.571019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.572517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.573601 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.803828 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:08.194000 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:08.220611 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fca99012-a28c-474c-8da6-8a64fc51bc7d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.695522 Aug 24 03:34:08.224463 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 80/164] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:07 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:09.287557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:09.290174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:09.302114 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:09.305543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=6 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:09.321425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.322898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.327493 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.330383 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.333580 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.336022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.640064 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:09.648401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-975b95f9-71a4-47db-8bde-ceb7f014fb94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.375674 Aug 24 03:34:09.648953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 85/165] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:09 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:10.672951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:10.673834 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:10.681872 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.682862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.683477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.684240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.685002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.685677 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.948835 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:10.963156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b075750e-ce0b-4516-996a-f716f822885b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.295921 Aug 24 03:34:10.977708 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 81/166] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:10 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:11.826082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-4bdb0c73-d4b2-45a8-a82f-421917ee2353 req-05af3c90-04ed-40ac-bb2a-b4a87c3b91d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f96d2d-64e5-4ae5-9c84-63221a8435e9", "name": "network-vif-plugged", "status": "completed", "tag": "8d45ac02-61e6-499b-88bf-8447cce35fe3"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:11.831440 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:11.840706 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-4bdb0c73-d4b2-45a8-a82f-421917ee2353 req-05af3c90-04ed-40ac-bb2a-b4a87c3b91d2 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.841182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-4bdb0c73-d4b2-45a8-a82f-421917ee2353 req-05af3c90-04ed-40ac-bb2a-b4a87c3b91d2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.848906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-4bdb0c73-d4b2-45a8-a82f-421917ee2353 req-05af3c90-04ed-40ac-bb2a-b4a87c3b91d2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.886432 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-4bdb0c73-d4b2-45a8-a82f-421917ee2353 req-05af3c90-04ed-40ac-bb2a-b4a87c3b91d2 service nova] Creating event network-vif-plugged:8d45ac02-61e6-499b-88bf-8447cce35fe3 for instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 on hv-cinder-85426 Aug 24 03:34:11.892754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-4bdb0c73-d4b2-45a8-a82f-421917ee2353 req-05af3c90-04ed-40ac-bb2a-b4a87c3b91d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070083 Aug 24 03:34:11.894835 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 86/167] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:11.995208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:11.999099 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:12.011714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.012216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.012657 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.013638 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.014076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.014891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.313971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:12.336040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-498e181f-6787-4491-bfa5-44b5ba83d21d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.354395 Aug 24 03:34:12.337735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 82/168] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:11 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:13.378457 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:13.384523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:13.412769 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.416858 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.419300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.421356 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.423000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.424092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.742058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.755486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-908e8c29-ff4d-4d30-b0a0-03f47e6dbf07 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1314 microversion: 2.1 time: 0.385564 Aug 24 03:34:13.756416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 87/169] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:13 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:14.803126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.808861 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:14.838567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.842320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.843614 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.849289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.850476 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.851530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:15.266636 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:15.333589 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b8fdc0ed-9ca4-4296-93b8-df3329f7ec8b tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1498 microversion: 2.1 time: 0.528800 Aug 24 03:34:15.335441 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 83/170] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1498 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:16.460586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:16.461953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:16.470024 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.470769 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.471715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.472771 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.473522 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.474299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.525339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:16.818517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-46f9aa60-91c4-4198-a149-9b31d609b4f5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 204 len: 0 microversion: 2.1 time: 0.371848 Aug 24 03:34:16.820939 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 88/171] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:16 2022] DELETE /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:16.836397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:16.838070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:16.864278 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.865122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.871613 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.873232 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.876117 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.877155 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:17.571055 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:17.596079 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ac6f4bf1-1cba-40b1-9f99-e2eef95e8763 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1504 microversion: 2.1 time: 0.768703 Aug 24 03:34:17.597934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 84/172] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:16 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1504 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:18.642481 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:18.644322 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:18.653452 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.654166 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.654819 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.655834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.656468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.656898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.130365 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:19.164590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-378a476f-13c3-49f5-a01f-587b1a114b75 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1504 microversion: 2.1 time: 0.527332 Aug 24 03:34:19.191661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 89/173] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:18 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:20.211176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:20.213194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:20.225531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.226206 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.226803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.228869 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.229861 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.230551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.678272 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:20.730784 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-af0e0400-a4d1-4135-9dd8-0ec0fd385d0d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1504 microversion: 2.1 time: 0.524380 Aug 24 03:34:20.752236 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 85/174] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:20 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:21.178709 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-899175ef-421b-4613-823f-cb217c3b0ae4 req-3c5655fa-4ac7-49e5-a62d-709f707eafc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f96d2d-64e5-4ae5-9c84-63221a8435e9", "name": "network-vif-deleted", "tag": "8d45ac02-61e6-499b-88bf-8447cce35fe3"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:21.224782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-899175ef-421b-4613-823f-cb217c3b0ae4 req-3c5655fa-4ac7-49e5-a62d-709f707eafc2 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.225366 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-899175ef-421b-4613-823f-cb217c3b0ae4 req-3c5655fa-4ac7-49e5-a62d-709f707eafc2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.226528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-899175ef-421b-4613-823f-cb217c3b0ae4 req-3c5655fa-4ac7-49e5-a62d-709f707eafc2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.315949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-899175ef-421b-4613-823f-cb217c3b0ae4 req-3c5655fa-4ac7-49e5-a62d-709f707eafc2 service nova] Creating event network-vif-deleted:8d45ac02-61e6-499b-88bf-8447cce35fe3 for instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 on hv-cinder-85426 Aug 24 03:34:21.326957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-899175ef-421b-4613-823f-cb217c3b0ae4 req-3c5655fa-4ac7-49e5-a62d-709f707eafc2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165971 Aug 24 03:34:21.336286 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 90/175] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:21.767176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:21.768275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:21.781033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.781559 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.783623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.784797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.788440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.789945 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.843574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.844290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.844935 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.845552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lazy-loading 'fault' on Instance uuid f3f96d2d-64e5-4ae5-9c84-63221a8435e9 {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:21.849448 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=94 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:21.927288 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:21.948807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b93b5a46-4e7e-4020-971c-fd3f4c955eea tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 200 len: 1304 microversion: 2.1 time: 0.186409 Aug 24 03:34:21.951086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 86/176] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:21 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:22.978229 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:22.983827 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: f3f96d2d-64e5-4ae5-9c84-63221a8435e9] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:23.000001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.002167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.007043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.009148 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.011336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.012483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.068824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] HTTP exception thrown: Instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 could not be found. Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Request method failure captured: Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 HTTP/1.1 Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZwfOx0C5i7NeGdDggiRQ3K3PgKWq1DfolxRJvIL0QSkY1txBiu0zvUJ6K5esouSmEfnqsj2YrQZOOdc_I_Fl3_l7G-vwsSxZpK5bqQbz8xjaB46egE8NnwODwSxOTHmflI3UFLZ__GNgjbcPMAjdeYvzKtZUGq-sjl-rWD7woz3mI8 Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 30db6d523c5c4763933b86c160ea3d87 Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesActionsTest-459416102 Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:34:23.071321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/30db6d523c5c4763933b86c160ea3d87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/30db6d523c5c4763933b86c160ea3d87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/30db6d523c5c4763933b86c160ea3d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_30db6d523c5c4763933b86c160ea3d87"}]}] Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesActionsTest-459416102 Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 30db6d523c5c4763933b86c160ea3d87 Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesActionsTest-459416102 Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesActionsTest-459416102-project Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 3d824b7cad264484bde1071e4e6306ad Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesActionsTest-459416102-project Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 could not be found. Aug 24 03:34:23.073838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': 'f3f96d2d-64e5-4ae5-9c84-63221a8435e9'} Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 could not be found. Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:23.076273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 could not be found. Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 could not be found. Aug 24 03:34:23.083590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:34:23.088198 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Returning 404 to user: Instance f3f96d2d-64e5-4ae5-9c84-63221a8435e9 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:23.088198 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-346fbdf2-0120-48b6-9db5-129a5e3125af tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9" status: 404 len: 111 microversion: 2.1 time: 0.104230 Aug 24 03:34:23.097211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 91/177] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:22 2022] GET /compute/v2.1/servers/f3f96d2d-64e5-4ae5-9c84-63221a8435e9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:23.379096 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1201765201", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "networks": [{"uuid": "9881b092-ecf0-4049-91cb-a639dc282d78"}]}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:23.458440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=45 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:23.631272 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] validate_networks() for [('9881b092-ecf0-4049-91cb-a639dc282d78', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:34:24.707830 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:34:24.710485 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:34:24.711472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:34:24.712290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:34:24.712996 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:34:24.736004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.737692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.738813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.742188 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.746350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.747472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.819114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Getting quotas for project 30db6d523c5c4763933b86c160ea3d87. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:24.846993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Getting quotas for user 3d824b7cad264484bde1071e4e6306ad and project 30db6d523c5c4763933b86c160ea3d87. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:24.937599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:34:24.952611 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:34:25.064512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7785abcb-5884-4f8e-845b-9ab9dc9af14d tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697066 Aug 24 03:34:25.068751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 87/178] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:34:25.085646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bf62b94f-8919-4d3c-8a83-1dea15970bb9 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:25.086677 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bf62b94f-8919-4d3c-8a83-1dea15970bb9 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:25.364351 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bf62b94f-8919-4d3c-8a83-1dea15970bb9 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:25.391780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bf62b94f-8919-4d3c-8a83-1dea15970bb9 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1214 microversion: 2.1 time: 0.310432 Aug 24 03:34:25.410773 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 88/179] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:25 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1214 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:25.472912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-571524022", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:25.721499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] validate_networks() for [('93612b14-fa84-4f16-a458-87833d8e8f3a', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:34:26.428206 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:26.430064 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:26.439852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:26.441519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:26.442459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:26.443519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:26.444167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:26.444811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:26.790896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:26.834547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-04e5681f-1378-458c-8b3c-d199d813ab03 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1218 microversion: 2.1 time: 0.412858 Aug 24 03:34:26.851962 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 89/180] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:26 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1218 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:27.041502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:34:27.044347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:34:27.045713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:34:27.046718 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:34:27.047821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:34:27.072335 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.073233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.074106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.075623 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.076723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.077506 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.150908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for project 66a102abeb7f46a292a49d1f022190e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:27.161079 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for user ae4f7f8855b5445d863a825ce921c982 and project 66a102abeb7f46a292a49d1f022190e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:27.211584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:34:27.216174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:34:27.323444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-01e489c1-2203-44e0-8a34-74f3ea25d8a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.912886 Aug 24 03:34:27.324113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 92/181] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:34:27.353633 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5d6b953c-ea34-4c3c-9ad9-69b75e3138e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:27.367765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5d6b953c-ea34-4c3c-9ad9-69b75e3138e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:27.516743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5d6b953c-ea34-4c3c-9ad9-69b75e3138e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:27.529513 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5d6b953c-ea34-4c3c-9ad9-69b75e3138e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1221 microversion: 2.1 time: 0.196249 Aug 24 03:34:27.531691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 90/182] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:27 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:27.889032 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:27.890207 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:27.938701 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.942532 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.944149 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.953601 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-203478504", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:27.958157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.960051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.971831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:28.378263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] validate_networks() for [('93612b14-fa84-4f16-a458-87833d8e8f3a', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:34:28.441481 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:28.470423 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0975170f-3603-4e91-ab4f-cc12c81eb6b5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1284 microversion: 2.1 time: 0.587127 Aug 24 03:34:28.475198 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 93/183] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:27 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1284 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:29.519569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:29.523665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:29.546490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.547721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.548984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.550822 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.552119 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.553314 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.927460 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:34:29.928307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:34:29.929297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:34:29.930092 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:34:29.931629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:34:29.985472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.988797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.992151 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.993678 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.994531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.995327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:30.089124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for project 66a102abeb7f46a292a49d1f022190e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:30.111140 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for user ae4f7f8855b5445d863a825ce921c982 and project 66a102abeb7f46a292a49d1f022190e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:30.178965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:34:30.184225 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:34:30.280475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:30.340339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c6b90560-67f2-4c37-9b2c-2abf58602089 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.830999 Aug 24 03:34:30.348200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 94/184] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:29 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:30.363081 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-86b9231b-d73c-4a11-b96c-5728e06e14b6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.413723 Aug 24 03:34:30.390849 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 91/185] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:34:30.391758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d5ccbf8f-ace9-43a4-bf45-46443b03310d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:30.393188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d5ccbf8f-ace9-43a4-bf45-46443b03310d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:30.635574 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d5ccbf8f-ace9-43a4-bf45-46443b03310d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:30.680147 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d5ccbf8f-ace9-43a4-bf45-46443b03310d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1221 microversion: 2.1 time: 0.303072 Aug 24 03:34:30.681155 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 95/186] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:30 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1221 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:31.395703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:31.401442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:31.437247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:31.445277 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:31.446236 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:31.447640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:31.448505 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:31.449289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:31.734567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f1c58af1-25eb-4d55-b259-1f3014c0f864 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:31.735841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f1c58af1-25eb-4d55-b259-1f3014c0f864 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:31.952190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:31.983107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9b420198-1d38-4190-b910-9c143330488a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.595889 Aug 24 03:34:31.985841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 92/187] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:31 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:32.114919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f1c58af1-25eb-4d55-b259-1f3014c0f864 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:32.153354 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f1c58af1-25eb-4d55-b259-1f3014c0f864 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1221 microversion: 2.1 time: 0.432535 Aug 24 03:34:32.154430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 96/188] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:31 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1221 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:33.021701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:33.022346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:33.044018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.044541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.045097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.045826 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.046331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.047003 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.114723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-3498326f-4621-4501-bb92-a1bb73aaaa96 req-70ccebc4-b5e7-4507-a56c-ee2edc2e63cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a71cc9f-51ee-4a80-a355-05402d31cf85", "tag": "db6cede0-8d3f-43be-a082-47edccc4bb64"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:33.142189 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3498326f-4621-4501-bb92-a1bb73aaaa96 req-70ccebc4-b5e7-4507-a56c-ee2edc2e63cc service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.143617 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3498326f-4621-4501-bb92-a1bb73aaaa96 req-70ccebc4-b5e7-4507-a56c-ee2edc2e63cc service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.144443 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3498326f-4621-4501-bb92-a1bb73aaaa96 req-70ccebc4-b5e7-4507-a56c-ee2edc2e63cc service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.169756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:33.236706 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-3498326f-4621-4501-bb92-a1bb73aaaa96 req-70ccebc4-b5e7-4507-a56c-ee2edc2e63cc service nova] Creating event network-changed:db6cede0-8d3f-43be-a082-47edccc4bb64 for instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 on hv-cinder-85426 Aug 24 03:34:33.250912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-3498326f-4621-4501-bb92-a1bb73aaaa96 req-70ccebc4-b5e7-4507-a56c-ee2edc2e63cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142768 Aug 24 03:34:33.276978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 97/189] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:33.289882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:33.290592 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:33.317250 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.317779 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.318536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.319467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.320094 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.324894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.419553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:33.434641 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-abe44adb-c27f-4339-a83a-a79ed81a6e0a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.416909 Aug 24 03:34:33.455347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 93/190] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:33 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:33.743400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:33.789514 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9873a512-0506-4588-86c2-d48899dfdafc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1291 microversion: 2.1 time: 0.509014 Aug 24 03:34:33.790841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 98/191] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:33 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1291 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:34.479618 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:34.482105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:34.515576 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.516783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.517569 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.519449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.520779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.521890 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.832415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:34.841587 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:34.853050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:34.855605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-af49e6fe-4ad3-4e89-b6b9-81b8d3da5023 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.391169 Aug 24 03:34:34.856735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 94/192] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:34 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:34.873729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.875455 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.876784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.879636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.881992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.885713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:35.010938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:35.025163 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6d923370-e506-4549-b411-1565f19ac83a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1279 microversion: 2.1 time: 0.213327 Aug 24 03:34:35.026069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 99/193] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:34 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:35.896865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:35.898832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:35.915560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:35.916847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:35.918099 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:35.919489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:35.920346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:35.921317 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.077576 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:36.079985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:36.092848 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.094153 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.095387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.097100 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.098527 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.099730 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.315877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:36.335040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d1c57b32-629d-4b31-9d0b-ebc91bd56160 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.443940 Aug 24 03:34:36.335040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 95/194] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:35 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:36.441334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:36.462989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9946d7a1-c3b5-4019-ac4e-618da5ab2ae1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.394659 Aug 24 03:34:36.465202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 100/195] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:36 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:37.362560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:37.364864 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:37.378704 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.380218 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.381323 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.382947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.384361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.385376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.507382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:37.511786 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:37.534603 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:37.538116 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.538919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.539601 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.540747 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.541475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.542142 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.787220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:37.811894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e00fe401-1372-45c1-a673-1e991825cf4c tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.456442 Aug 24 03:34:37.843472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 96/196] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:37 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:37.871930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:37.903986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6f3d11bd-5d6a-4ce5-8bee-e171e94bf422 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.404702 Aug 24 03:34:37.905001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 101/197] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:37 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:38.866799 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.867524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:38.880999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.881498 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.895443 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.896290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.896748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.897399 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.948871 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.954187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:38.976898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.978138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.979155 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.981882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.982897 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.984094 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:39.791016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:39.798193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:39.809551 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4d9af690-8677-4a0d-8b37-9ee433eabf8f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.872811 Aug 24 03:34:39.810918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 102/198] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:39.826086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-983beb8a-7ea6-4877-a47e-d35c32f4eac5 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.964434 Aug 24 03:34:39.827793 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 97/199] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:39.950815 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-bd753db7-7806-40bd-8252-02cb0e1972f1 req-6627f86a-d559-467c-a369-90a46de860d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14a955e-8274-4ad0-af0d-a9e41d7bade7", "tag": "c96315d0-bdcc-4083-a370-1f4ff17b9596"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:39.971860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-bd753db7-7806-40bd-8252-02cb0e1972f1 req-6627f86a-d559-467c-a369-90a46de860d5 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:39.972734 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-bd753db7-7806-40bd-8252-02cb0e1972f1 req-6627f86a-d559-467c-a369-90a46de860d5 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:39.973357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-bd753db7-7806-40bd-8252-02cb0e1972f1 req-6627f86a-d559-467c-a369-90a46de860d5 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:40.009469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-bd753db7-7806-40bd-8252-02cb0e1972f1 req-6627f86a-d559-467c-a369-90a46de860d5 service nova] Creating event network-changed:c96315d0-bdcc-4083-a370-1f4ff17b9596 for instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 on hv-cinder-85426 Aug 24 03:34:40.019466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-bd753db7-7806-40bd-8252-02cb0e1972f1 req-6627f86a-d559-467c-a369-90a46de860d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075607 Aug 24 03:34:40.020594 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 103/200] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:40.236314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-2507cd79-0cf8-47df-92aa-182f7828243c req-bcc84a34-6721-4c4c-b0cf-64e9fecf0317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a71cc9f-51ee-4a80-a355-05402d31cf85", "name": "network-vif-plugged", "status": "completed", "tag": "db6cede0-8d3f-43be-a082-47edccc4bb64"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:40.244726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=4 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:40.246256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=16 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:40.257507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2507cd79-0cf8-47df-92aa-182f7828243c req-bcc84a34-6721-4c4c-b0cf-64e9fecf0317 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:40.258059 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2507cd79-0cf8-47df-92aa-182f7828243c req-bcc84a34-6721-4c4c-b0cf-64e9fecf0317 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:40.259373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2507cd79-0cf8-47df-92aa-182f7828243c req-bcc84a34-6721-4c4c-b0cf-64e9fecf0317 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:40.275489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-2507cd79-0cf8-47df-92aa-182f7828243c req-bcc84a34-6721-4c4c-b0cf-64e9fecf0317 service nova] Creating event network-vif-plugged:db6cede0-8d3f-43be-a082-47edccc4bb64 for instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 on hv-cinder-85426 Aug 24 03:34:40.282364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-2507cd79-0cf8-47df-92aa-182f7828243c req-bcc84a34-6721-4c4c-b0cf-64e9fecf0317 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049126 Aug 24 03:34:40.283467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 98/201] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:40.865491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:40.866355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:40.870358 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:40.875234 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:40.885217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:40.885217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:40.885217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:40.885217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:40.885941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:40.885941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:40.900164 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:40.901675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:40.905846 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:40.907989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:40.908799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:40.910416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:41.309028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:41.324187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a230e4c5-10b8-4fd3-aa36-a8364f521c29 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.463817 Aug 24 03:34:41.324885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 99/202] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:40 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:41.370456 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:41.388815 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cbc6ec9b-a493-422a-aa1d-be6d34381ab4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.536880 Aug 24 03:34:41.390411 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 104/203] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:40 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:42.064694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-ba93a514-c244-4792-b9a1-9a78a005e79a req-92637062-ed40-4808-950d-dce43b85f88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28871953-1a38-47d3-968e-1bb911d42077", "tag": "3141fca6-9212-4b42-8107-08873cc7cd08"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:42.079021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-ba93a514-c244-4792-b9a1-9a78a005e79a req-92637062-ed40-4808-950d-dce43b85f88f service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.079693 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-ba93a514-c244-4792-b9a1-9a78a005e79a req-92637062-ed40-4808-950d-dce43b85f88f service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.080340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-ba93a514-c244-4792-b9a1-9a78a005e79a req-92637062-ed40-4808-950d-dce43b85f88f service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.114903 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-ba93a514-c244-4792-b9a1-9a78a005e79a req-92637062-ed40-4808-950d-dce43b85f88f service nova] Creating event network-changed:3141fca6-9212-4b42-8107-08873cc7cd08 for instance 28871953-1a38-47d3-968e-1bb911d42077 on hv-cinder-85426 Aug 24 03:34:42.123223 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-ba93a514-c244-4792-b9a1-9a78a005e79a req-92637062-ed40-4808-950d-dce43b85f88f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063193 Aug 24 03:34:42.124082 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 100/204] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:42.356463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:42.357331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:42.371647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=10 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:42.372940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:42.388970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.392469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.395850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.398621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.399517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.400722 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.423337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:42.427406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:42.442053 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.444360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.445431 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.446688 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.447306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.447776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.860946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:42.870527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:42.875060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-30b28857-8361-4d36-ac0d-213dbeb43ad7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.524065 Aug 24 03:34:42.888179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-36370b66-a373-499a-a3b9-b697870feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.475978 Aug 24 03:34:42.891533 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 105/205] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:42 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:42.903320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 101/206] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:42 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:43.913626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.923899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.927253 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:43.928074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:43.949732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:43.951472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:43.952585 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:43.953435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:43.954642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:43.955743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:43.957810 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:43.959807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:43.960132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:43.961690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:43.962936 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:43.968048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.286117 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:44.298339 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:44.313347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-da30a293-39de-4d78-a3b5-c73d17ef93ac tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.395457 Aug 24 03:34:44.313688 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-78d524ca-0084-4114-b4d0-f3396f7ac581 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.405616 Aug 24 03:34:44.314316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 102/207] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:44.327082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 106/208] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:45.336028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:45.336628 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:45.344415 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:45.345232 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:45.346350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:45.347626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:45.348289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:45.348983 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:45.349632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:45.350261 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:45.358154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:45.359144 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:45.359604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:45.360348 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:45.360815 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:45.361652 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:45.592797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:45.604147 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a5516a5c-8089-4ee0-bd02-0721429eba94 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.259861 Aug 24 03:34:45.611725 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:45.619448 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 107/209] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:45 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:45.639485 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c2f17660-a24e-4a1e-93be-f72653ef67da tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.307473 Aug 24 03:34:45.641047 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 103/210] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:45 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:45.685209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-620936776", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "networks": [{"uuid": "9ed880dc-9032-4bf8-b7c3-b645c6c79824"}]}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:45.768760 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] validate_networks() for [('9ed880dc-9032-4bf8-b7c3-b645c6c79824', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:34:46.385677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:34:46.386341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:34:46.386780 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:34:46.387413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:34:46.388125 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:34:46.399596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.400168 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.400703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.401618 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.402367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.402974 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.435962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Getting quotas for project 727bfec133af4b0db4dd397ee32fbb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:46.445247 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Getting quotas for user b985a376cdbd45bf80a3142ffbd81fba and project 727bfec133af4b0db4dd397ee32fbb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:46.460750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:34:46.463238 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:34:46.523495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7d45ec34-40bb-4f07-ab66-4b22636ed67f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842919 Aug 24 03:34:46.524234 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 108/211] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:34:46.537963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e4008d8e-3c24-45f7-94f8-34c650f701d9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:46.539041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e4008d8e-3c24-45f7-94f8-34c650f701d9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:46.608644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e4008d8e-3c24-45f7-94f8-34c650f701d9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:46.623603 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e4008d8e-3c24-45f7-94f8-34c650f701d9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1218 microversion: 2.1 time: 0.091050 Aug 24 03:34:46.624786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 104/212] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:46 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:46.630984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:46.632213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:46.644622 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.645797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.646802 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.649340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.650614 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.651348 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.683528 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:46.684923 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:46.696728 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.697957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.698916 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.700435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.701461 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.702612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.936928 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:46.961971 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6f440207-9a14-4c5d-9a17-82e566b077eb tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.339482 Aug 24 03:34:46.963175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 109/213] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:46 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:47.015002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:47.031625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-064acfcc-13a6-4543-a5c3-c3512887864e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.354781 Aug 24 03:34:47.046343 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 105/214] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:46 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:47.655430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:47.656273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:47.663245 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:47.663741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:47.664180 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:47.664897 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:47.665353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:47.665788 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:47.742948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:47.754674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dd8fb4c3-559a-4ea5-a932-e23c348f9607 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1222 microversion: 2.1 time: 0.103443 Aug 24 03:34:47.755289 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 110/215] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:47 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:47.997930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:47.999156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:48.009032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.009522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.009963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.010739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.011207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.011635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.066249 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:48.067392 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:48.078843 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.079992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.080860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.082213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.083192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.083980 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.296456 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:48.305816 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2a3f4770-0185-4b09-8413-fc47434dcbfd tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.315019 Aug 24 03:34:48.306583 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 106/216] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:47 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:48.378210 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:48.394283 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0eb75b29-3b54-4a22-a9ef-dbfc06c6c295 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.335261 Aug 24 03:34:48.395481 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 111/217] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:48 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:48.781107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:48.782228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:48.794025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.794930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.795707 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.797234 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.798179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.799071 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.850490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-4d7152f7-4b73-4b20-bdc5-6f4c52a04b40 req-f00e3d7a-46eb-46e1-8cfe-dbcd311c141b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14a955e-8274-4ad0-af0d-a9e41d7bade7", "name": "network-vif-plugged", "status": "completed", "tag": "c96315d0-bdcc-4083-a370-1f4ff17b9596"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:48.868767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-4d7152f7-4b73-4b20-bdc5-6f4c52a04b40 req-f00e3d7a-46eb-46e1-8cfe-dbcd311c141b service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.869517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-4d7152f7-4b73-4b20-bdc5-6f4c52a04b40 req-f00e3d7a-46eb-46e1-8cfe-dbcd311c141b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.870054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-4d7152f7-4b73-4b20-bdc5-6f4c52a04b40 req-f00e3d7a-46eb-46e1-8cfe-dbcd311c141b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.884917 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-4d7152f7-4b73-4b20-bdc5-6f4c52a04b40 req-f00e3d7a-46eb-46e1-8cfe-dbcd311c141b service nova] Creating event network-vif-plugged:c96315d0-bdcc-4083-a370-1f4ff17b9596 for instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 on hv-cinder-85426 Aug 24 03:34:48.895806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-4d7152f7-4b73-4b20-bdc5-6f4c52a04b40 req-f00e3d7a-46eb-46e1-8cfe-dbcd311c141b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051957 Aug 24 03:34:48.897805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 112/218] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:48.938088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:48.954301 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5cf50020-52b2-4984-8a0c-be55f7f8eae9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1222 microversion: 2.1 time: 0.179686 Aug 24 03:34:48.962699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 107/219] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:48 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:49.345351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:49.346571 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:49.354278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.354826 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.355276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.356035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.356502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.356932 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.428537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:49.429759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:49.442608 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.443516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.444662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.445577 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.446390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.447178 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.556060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:49.571337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e5e343e0-ce17-4199-8867-d8da34acfa9f tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1314 microversion: 2.1 time: 0.232202 Aug 24 03:34:49.572514 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 113/220] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:49 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:49.648831 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:49.651358 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:49.658726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b40f2845-6d1b-42d0-81a5-d06d7d6859e7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.234568 Aug 24 03:34:49.659424 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 108/221] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:49 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:49.994268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:49.996200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:50.011396 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.012638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.013593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:50.014748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.015572 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.016414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:50.204436 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:50.218163 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9e684fdf-8e85-4850-8bf1-c92bb5842bc8 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1222 microversion: 2.1 time: 0.232683 Aug 24 03:34:50.219169 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 114/222] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:49 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1222 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:50.630579 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:50.645129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:50.688689 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:50.694830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:50.707430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.710858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.713551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:50.717219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.719144 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.720636 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:50.732323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.733065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.733852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:50.735317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.736296 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.737547 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.212449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:51.218193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:51.223298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6d5d3c82-c666-4c0c-82a8-1eb349df3d23 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1498 microversion: 2.1 time: 0.624504 Aug 24 03:34:51.224166 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 109/223] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:50 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1498 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:51.227982 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-47b3c48d-1292-4cec-bf1c-0f71382f4470 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.550411 Aug 24 03:34:51.228569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 115/224] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:50 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:51.255319 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:51.256147 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:51.264249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:51.264748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:51.265189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.265932 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:51.266398 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:51.266876 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.342293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:51.352650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d5496b8f-005e-4c1c-9ed0-478557df8deb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1270 microversion: 2.1 time: 0.104004 Aug 24 03:34:51.353272 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 110/225] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:51 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:51.903065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:51.903944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:51.912034 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:51.916374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:51.916374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.916374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:51.916374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:51.917023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.941236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:51.954426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:52.084833 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b355257d-c8fa-4713-bf78-0162436d4869 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 204 len: 0 microversion: 2.1 time: 0.188553 Aug 24 03:34:52.085610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 116/226] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:51 2022] DELETE /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:52.095658 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:52.096710 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:52.104424 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.105071 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.105625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.106480 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.107116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.107640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.263853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:52.265131 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:52.275943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.276818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.277602 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.278805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.279637 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.280357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.284273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:52.298762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-069939ee-1886-446c-b7bf-001968cc3298 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1504 microversion: 2.1 time: 0.207237 Aug 24 03:34:52.300584 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 111/227] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:52 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:52.390403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:52.391475 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:52.402548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.403402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.404061 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.404951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.405471 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.405948 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.546446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:52.553309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:52.564985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ede7d979-7eef-4fbe-89e1-c69b956a7d09 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1278 microversion: 2.1 time: 0.181372 Aug 24 03:34:52.566729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 112/228] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:52 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:52.584113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-01fa9681-b53f-4c45-b197-2ed266dd35a7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.328465 Aug 24 03:34:52.585874 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 117/229] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:52 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:53.340635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.341648 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.351157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.351863 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.352468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.353286 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.353852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.354367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.411233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-0776ebbb-27f0-47c6-bcfb-e863d31d343f req-c35eab51-cb44-46c6-be69-2b218e5daf89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28871953-1a38-47d3-968e-1bb911d42077", "name": "network-vif-plugged", "status": "completed", "tag": "3141fca6-9212-4b42-8107-08873cc7cd08"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:53.443235 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-0776ebbb-27f0-47c6-bcfb-e863d31d343f req-c35eab51-cb44-46c6-be69-2b218e5daf89 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.444534 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-0776ebbb-27f0-47c6-bcfb-e863d31d343f req-c35eab51-cb44-46c6-be69-2b218e5daf89 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.445347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-0776ebbb-27f0-47c6-bcfb-e863d31d343f req-c35eab51-cb44-46c6-be69-2b218e5daf89 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.468952 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-0776ebbb-27f0-47c6-bcfb-e863d31d343f req-c35eab51-cb44-46c6-be69-2b218e5daf89 service nova] Creating event network-vif-plugged:3141fca6-9212-4b42-8107-08873cc7cd08 for instance 28871953-1a38-47d3-968e-1bb911d42077 on hv-cinder-85426 Aug 24 03:34:53.477511 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-0776ebbb-27f0-47c6-bcfb-e863d31d343f req-c35eab51-cb44-46c6-be69-2b218e5daf89 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084614 Aug 24 03:34:53.478175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 118/230] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:53.605932 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.606698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:53.607505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.621897 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.622959 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.623319 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8b01bc48-1c83-4579-94a3-c8315db82ee7 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1504 microversion: 2.1 time: 0.287385 Aug 24 03:34:53.623870 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.624056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 113/231] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:53.625392 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.626350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.627343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.631864 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.631864 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.635935 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:53.637435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.638829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.639300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.640085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.640554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.640983 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.761520 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:53.777065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f7527528-8690-4e6a-a436-a79358e6dec9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1278 microversion: 2.1 time: 0.179672 Aug 24 03:34:53.777875 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 119/232] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:53.873209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:53.885825 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6fe8e1af-e191-481a-853e-0434ab1fe60d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.260344 Aug 24 03:34:53.886895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 114/233] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:54.657494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:54.658429 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:54.666159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.666742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.667328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.668306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.668866 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.669377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.805513 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:54.806426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:54.815568 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.816423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.818458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.820296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.821139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.821901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.955922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:54.956713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:54.971075 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1003befa-0fac-4985-b2bb-09e5a8e56b78 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1276 microversion: 2.1 time: 0.169861 Aug 24 03:34:54.971977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-88a3d6d0-5ea3-4e3c-ac41-4b3b0c3a7387 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1504 microversion: 2.1 time: 0.312875 Aug 24 03:34:54.972691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 115/234] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:54 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:54.982713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:54.984012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:54.986343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 120/235] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:54 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:54.996041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.997300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.998135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.001108 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.002005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.002829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.374943 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:55.390230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f38fd6e0-3267-43d7-97b3-aeb7fafe49be tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.414849 Aug 24 03:34:55.391326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 116/236] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:54 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:55.997165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:55.998222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:56.009040 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.009806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.010485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.011704 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.012490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.013227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.029999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:56.031125 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:56.044183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.045691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.046435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.047761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.048538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.049561 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.115312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:56.136159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9844cede-40a4-4511-a5b6-4d8737f88b3f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1276 microversion: 2.1 time: 0.145351 Aug 24 03:34:56.139345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 121/237] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:55 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:56.308735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:56.325158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-906348ca-65a7-432a-b951-ff1b23cde7a6 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1504 microversion: 2.1 time: 0.302675 Aug 24 03:34:56.326040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 117/238] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:56 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:56.423957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:56.425004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:56.427293 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:56.433414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.437296 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.438122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.439947 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.440761 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.441434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.461451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=6 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:56.593151 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-00e0c3d2-692c-4f49-a263-3b17fd3697a1 req-7b9eaeaa-bb2b-4be6-a6b6-178e6814f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a71cc9f-51ee-4a80-a355-05402d31cf85", "name": "network-vif-deleted", "tag": "db6cede0-8d3f-43be-a082-47edccc4bb64"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:56.636142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:56.638353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-00e0c3d2-692c-4f49-a263-3b17fd3697a1 req-7b9eaeaa-bb2b-4be6-a6b6-178e6814f1bd service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.639392 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-00e0c3d2-692c-4f49-a263-3b17fd3697a1 req-7b9eaeaa-bb2b-4be6-a6b6-178e6814f1bd service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.640253 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-00e0c3d2-692c-4f49-a263-3b17fd3697a1 req-7b9eaeaa-bb2b-4be6-a6b6-178e6814f1bd service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.658783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-00e0c3d2-692c-4f49-a263-3b17fd3697a1 req-7b9eaeaa-bb2b-4be6-a6b6-178e6814f1bd service nova] Creating event network-vif-deleted:db6cede0-8d3f-43be-a082-47edccc4bb64 for instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 on hv-cinder-85426 Aug 24 03:34:56.665158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-00e0c3d2-692c-4f49-a263-3b17fd3697a1 req-7b9eaeaa-bb2b-4be6-a6b6-178e6814f1bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085762 Aug 24 03:34:56.666454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 118/239] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:56.682265 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:56.700250 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1fecb19e-bbb6-49fb-af60-5a823b31e86a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1321 microversion: 2.1 time: 0.280459 Aug 24 03:34:56.701367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 122/240] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:56 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:57.172021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:57.173402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:57.202841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.206157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.212941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.214462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.215246 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.216015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.367625 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:57.368850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:57.379930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.380663 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.381453 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.383097 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.384241 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.385009 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.440729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.441859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.442826 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.443856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lazy-loading 'fault' on Instance uuid 7a71cc9f-51ee-4a80-a355-05402d31cf85 {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:57.610046 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d824b7cad264484bde1071e4e6306ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db6d523c5c4763933b86c160ea3d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:57.644987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dec45b7f-ee4a-4876-bbc5-f7f1b7b0e506 tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 200 len: 1304 microversion: 2.1 time: 0.285540 Aug 24 03:34:57.649479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 123/241] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:57 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 1304 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:57.658276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:57.692039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7321ef65-7fed-417e-91a0-e483c32103c2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.529270 Aug 24 03:34:57.707899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 119/242] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:57 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:57.743813 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:57.746675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:57.781770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.782924 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.783607 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.784909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.785732 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.786490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.048714 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:58.088137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-090d8fa2-4996-4610-bb7e-8d27dd656b5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1516 microversion: 2.1 time: 0.353755 Aug 24 03:34:58.092502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 124/243] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:57 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:58.148285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:58.154687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.165677 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.167437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.168183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.169189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.169938 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.170817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.213687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lazy-loading 'flavor' on Instance uuid 28871953-1a38-47d3-968e-1bb911d42077 {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:58.360095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3a22d67a-ac1f-40cb-a842-0700a92e1414 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077/action" status: 200 len: 32 microversion: 2.1 time: 0.218076 Aug 24 03:34:58.360837 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 120/244] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:34:58 2022] POST /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:58.375871 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.377056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.391248 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.392685 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.393748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.395392 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.396225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.397004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.637217 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:58.648245 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-aeb9578f-d719-4456-87ae-d4e1256e333c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.279432 Aug 24 03:34:58.648968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 125/245] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:58 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:58.693158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.694929 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] [instance: 7a71cc9f-51ee-4a80-a355-05402d31cf85] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.705588 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-ddb409c3-e282-40d9-bec3-8ca31f5dc295 req-a923aa0d-b456-4d60-a520-34c722f18f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57df7f0f-a745-4701-ac63-b999f27fb3c4", "tag": "08dfef01-c1f9-43ee-8a63-4b93325cac06"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:58.710229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.711103 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.711921 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.713441 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.714516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.716122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.718598 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-ddb409c3-e282-40d9-bec3-8ca31f5dc295 req-a923aa0d-b456-4d60-a520-34c722f18f02 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.719611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-ddb409c3-e282-40d9-bec3-8ca31f5dc295 req-a923aa0d-b456-4d60-a520-34c722f18f02 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.720546 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-ddb409c3-e282-40d9-bec3-8ca31f5dc295 req-a923aa0d-b456-4d60-a520-34c722f18f02 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.740095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-ddb409c3-e282-40d9-bec3-8ca31f5dc295 req-a923aa0d-b456-4d60-a520-34c722f18f02 service nova] Creating event network-changed:08dfef01-c1f9-43ee-8a63-4b93325cac06 for instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 on hv-cinder-85426 Aug 24 03:34:58.742280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] HTTP exception thrown: Instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 could not be found. Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Request method failure captured: Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 HTTP/1.1 Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZwfOx0C5i7NeGdDggiRQ3K3PgKWq1DfolxRJvIL0QSkY1txBiu0zvUJ6K5esouSmEfnqsj2YrQZOOdc_I_Fl3_l7G-vwsSxZpK5bqQbz8xjaB46egE8NnwODwSxOTHmflI3UFLZ__GNgjbcPMAjdeYvzKtZUGq-sjl-rWD7woz3mI8 Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 30db6d523c5c4763933b86c160ea3d87 Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-VolumesActionsTest-459416102 Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:34:58.747204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/30db6d523c5c4763933b86c160ea3d87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/30db6d523c5c4763933b86c160ea3d87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/30db6d523c5c4763933b86c160ea3d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_30db6d523c5c4763933b86c160ea3d87"}]}] Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-VolumesActionsTest-459416102 Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 30db6d523c5c4763933b86c160ea3d87 Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-VolumesActionsTest-459416102 Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-VolumesActionsTest-459416102-project Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 3d824b7cad264484bde1071e4e6306ad Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-VolumesActionsTest-459416102-project Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 could not be found. Aug 24 03:34:58.750153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '7a71cc9f-51ee-4a80-a355-05402d31cf85'} Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 could not be found. Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:58.751713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 could not be found. Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 could not be found. Aug 24 03:34:58.753786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:34:58.755536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-ddb409c3-e282-40d9-bec3-8ca31f5dc295 req-a923aa0d-b456-4d60-a520-34c722f18f02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046096 Aug 24 03:34:58.755536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 126/246] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:58.756413 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] Returning 404 to user: Instance 7a71cc9f-51ee-4a80-a355-05402d31cf85 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:58.757523 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-70ed477d-39a8-498f-a076-c5bf97b5ac6a tempest-VolumesActionsTest-459416102 tempest-VolumesActionsTest-459416102-project] 10.222.0.78 "GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85" status: 404 len: 111 microversion: 2.1 time: 0.073708 Aug 24 03:34:58.758820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 121/247] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:58 2022] GET /compute/v2.1/servers/7a71cc9f-51ee-4a80-a355-05402d31cf85 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:58.761335 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.762905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.776484 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.777354 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.778104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.779827 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.781697 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.782474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.993597 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.010189 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fcb65a0b-02c5-4bba-8198-b6a654f2fb19 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.258855 Aug 24 03:34:59.011310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 127/248] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:58 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:59.689819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:59.691176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:59.701729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.702216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.702721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.703444 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.704078 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.704551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.047719 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:00.048774 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:00.057122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.058095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.058668 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.059632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.060207 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.060710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.207575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:00.223426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-45c55a64-c30c-4852-9a51-604cec9c9615 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.541512 Aug 24 03:35:00.224839 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 122/249] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:59 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:00.293652 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:00.308399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-536c8caa-856a-499e-886d-19905d9d1d8a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.265575 Aug 24 03:35:00.309311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 128/250] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:00 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:01.264337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:01.265428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:01.276845 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.277592 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.285731 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.285731 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.285731 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.285731 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.336164 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:01.337470 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:01.349950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.351042 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.352040 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.353221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.353980 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.354795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.571950 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.599864 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-67a6f207-d991-4652-9ca4-ac2321c827e0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.342118 Aug 24 03:35:01.601090 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 123/251] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:01 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:01.676886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.691236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a5228f50-4ba1-4074-9cab-736e3a4ffd2a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.362409 Aug 24 03:35:01.692618 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 129/252] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:01 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:02.636350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:02.637718 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:02.646891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.647849 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.648560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.649486 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.649990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.650714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.743403 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:02.745158 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:02.778360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.779744 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.780434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.781597 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.782470 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.783186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:03.049534 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:03.058215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:03.080094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6024e2fe-68cd-41c8-89b6-06932d1d82c5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.447040 Aug 24 03:35:03.082052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 124/253] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:02 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:03.180294 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:03.202477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6cb9c5e4-6765-4452-bf37-5bcd822ecffb tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.474165 Aug 24 03:35:03.204084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 130/254] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:02 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:04.110634 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:04.113414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:04.129467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.130745 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.131814 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.133468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.134573 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.135765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.239268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:04.240343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:04.254490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.255812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.256386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.258052 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.258702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.259521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.619189 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:04.633802 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-246b3cbb-6fa4-4ee3-8525-036e16085e00 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.398849 Aug 24 03:35:04.636339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 131/255] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:04 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:04.688377 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:04.700595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4e6cf14e-da32-40c9-88a0-8752ebf3b30b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.598619 Aug 24 03:35:04.701411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 125/256] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:04 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:05.671185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:05.672801 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:05.680583 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:05.681095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:05.681619 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:05.682366 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:05.682862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:05.683936 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:05.707932 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:05.729971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:05.731994 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:05.745682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:05.753711 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:05.760820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:05.762495 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:05.764432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:05.765232 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:05.960443 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:05.977503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-71f3ac7f-5ef7-4a59-a968-c1b0b7cbe2c0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.315984 Aug 24 03:35:05.984350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 132/257] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:05 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:06.061448 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.076646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c064cd1a-11ca-4b1d-bc57-7408f6693520 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.350826 Aug 24 03:35:06.078225 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 126/258] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:05 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:06.168398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-28ead1aa-81d9-43a1-84f1-ffa54a1176b2 req-14323745-2b05-4875-9a7c-43e07048d527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57df7f0f-a745-4701-ac63-b999f27fb3c4", "name": "network-vif-plugged", "status": "completed", "tag": "08dfef01-c1f9-43ee-8a63-4b93325cac06"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:06.183786 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-28ead1aa-81d9-43a1-84f1-ffa54a1176b2 req-14323745-2b05-4875-9a7c-43e07048d527 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.184949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-28ead1aa-81d9-43a1-84f1-ffa54a1176b2 req-14323745-2b05-4875-9a7c-43e07048d527 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.186386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-28ead1aa-81d9-43a1-84f1-ffa54a1176b2 req-14323745-2b05-4875-9a7c-43e07048d527 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.204084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-28ead1aa-81d9-43a1-84f1-ffa54a1176b2 req-14323745-2b05-4875-9a7c-43e07048d527 service nova] Creating event network-vif-plugged:08dfef01-c1f9-43ee-8a63-4b93325cac06 for instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 on hv-cinder-85426 Aug 24 03:35:06.210465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-28ead1aa-81d9-43a1-84f1-ffa54a1176b2 req-14323745-2b05-4875-9a7c-43e07048d527 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049780 Aug 24 03:35:06.211725 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 133/259] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:07.032191 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.034617 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:07.043778 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.044364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.045014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.045759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.046228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.046692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.106481 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.109153 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:07.122105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.123168 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.123961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.124832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.130899 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.131595 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.414337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.430944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b7cf4ddb-8b13-4f6d-a62d-420a4a1ab121 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.405840 Aug 24 03:35:07.445835 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 127/260] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:07.473512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.487886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b922e31d-f957-4c73-b9b8-a7f9ebdaa03b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.390827 Aug 24 03:35:07.488907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 134/261] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:08.461591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:08.462605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:08.474129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.475133 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.475902 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.476822 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.477446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.478040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.533936 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:08.535050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:08.544752 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.551898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.552610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.553821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.555143 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.555882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.848572 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:08.872656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a201a30e-94b3-4cea-b469-1d7582a199b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1318 microversion: 2.1 time: 0.421141 Aug 24 03:35:08.874355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 128/262] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:08 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:08.918279 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:08.928352 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4a26bc08-d7e9-4a94-b7ee-a3f9f0fdf795 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.410653 Aug 24 03:35:08.929078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 135/263] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:08 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:09.903397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.905326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.914015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.914700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.915399 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.916162 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.916925 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.917774 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.954232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.956552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.980909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.981425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.982203 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.983486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.984552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.985496 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.176027 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.192305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2463a961-d4f1-4527-880d-016eec33689b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1507 microversion: 2.1 time: 0.293655 Aug 24 03:35:10.193770 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 129/264] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:09 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:10.280476 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.302185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-db93dd10-f095-4680-b1a9-dd53b2135265 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.353518 Aug 24 03:35:10.314767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 136/265] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:09 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:11.338468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:11.339918 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:11.349073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.349883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.350334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.351121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.351610 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.352049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.600630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:11.627820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8cad2b37-9daf-40ae-b0ee-32727fa8b82a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.294140 Aug 24 03:35:11.628873 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 130/266] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:11 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:12.669217 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:12.670697 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:12.676193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:12.689317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.690294 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.691323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.693227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.694339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.695238 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.916111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:12.927756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8ea61555-4428-4a75-9292-2984c66afb51 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.268740 Aug 24 03:35:12.944388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 137/267] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:12 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:13.960265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:13.962895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:13.975954 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.976727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.977315 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.978458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.979114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.979649 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.233048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.255581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-575071c1-1e8e-46e9-bf33-55515716234b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.301849 Aug 24 03:35:14.258055 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 131/268] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:13 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:15.296089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:15.298294 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:15.308091 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.308777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.309328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.310521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.311740 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.312454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.572062 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:15.596365 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ee0e05ba-2634-4aa1-9caa-7bbb7fd72741 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.304401 Aug 24 03:35:15.598940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 138/269] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:15 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:16.632444 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:16.633237 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.646601 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.647818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.649591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.651223 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.652001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.652931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.875474 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.887933 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cf933cc5-9c02-4cab-a3fa-72a2a3fa2ad6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.259723 Aug 24 03:35:16.894690 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 132/270] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:16 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:17.929654 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:17.930503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:17.938736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.939323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.939961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.941220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.942034 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.942905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.198696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:18.213208 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-806dc6d2-8a40-4f94-a35d-1d351009a9ec tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.289233 Aug 24 03:35:18.214356 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 139/271] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:17 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:19.240307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:19.241140 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:19.250337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:19.251963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:19.253619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:19.253619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:19.253619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:19.253619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:19.458961 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.473734 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ab744f1a-4356-49f4-82d5-ba52525076a4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.237699 Aug 24 03:35:19.515415 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 133/272] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:19 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:20.515796 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:20.517049 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:20.524531 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.525270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.525844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.526737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.528421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.528421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.752902 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:20.762345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e68922ea-b48c-4ee6-b090-7584b1d53908 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.251050 Aug 24 03:35:20.763066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 140/273] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:20 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:21.790907 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:21.791800 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:21.803360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:21.803877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:21.804205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:21.804953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:21.805413 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:21.805883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:22.052281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:22.063980 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0ebf4c70-f49c-41ce-b0d3-4e231920da8e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.276899 Aug 24 03:35:22.064742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 134/274] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:21 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:23.092193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:23.093524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:23.120269 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:23.121058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:23.121501 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:23.123430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:23.123430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:23.124260 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:23.364882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:23.374749 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-79481afb-b9c7-488d-9631-7026189a54cb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.286595 Aug 24 03:35:23.376214 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 141/275] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:23 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:24.059490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:24.062205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:24.065878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=42 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:24.075200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.075978 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.076699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.078722 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.078983 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.080182 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.131070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c4ab219f-ffa6-4a6c-9cd0-477af10422b9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/ips" status: 200 len: 144 microversion: 2.1 time: 0.081585 Aug 24 03:35:24.132410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 135/276] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:35:24 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/ips => generated 144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:24.414683 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:24.416709 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:24.427200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.428030 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.428807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.429848 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.430536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.431027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.727047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:24.749792 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-df4e7239-c331-47e5-847d-8d0bc91ebec2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.342078 Aug 24 03:35:24.767410 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 142/277] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:24 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:25.784184 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:25.785071 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:25.792882 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.793440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.793929 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.794856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.795369 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.795909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:26.012095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.021687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-366bdae9-b558-4e41-9cec-f5b3709473ee tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.241756 Aug 24 03:35:26.022394 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 136/278] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:25 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:27.046824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:27.047718 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:27.055976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.056735 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.057342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.058162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.058943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.059494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.304842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:27.324391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e46a2da2-d71e-46ef-af27-52c32ba96f8b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.283525 Aug 24 03:35:27.325047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 143/279] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:27 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:28.354481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:28.355537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:28.378417 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.379262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.379809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:28.380676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.381245 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.381839 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:28.602421 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:28.620688 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-44753bad-7b5e-4ef7-b836-45bb86545a65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.273350 Aug 24 03:35:28.621620 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 137/280] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:28 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:28.743831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da68b0cb-5674-4d12-b086-470f3f03d6e7"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:28.749468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:28.761391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.762246 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.763122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:28.764628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.765522 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.766513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.303225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2e127679-cf47-43ff-82bd-ffaada8e80aa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571335 Aug 24 03:35:29.304407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 144/281] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:35:28 2022] POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:29.649067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:29.651029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:29.662542 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.663561 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.664427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.665803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.666772 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.667641 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.917763 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:29.933123 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d2d93627-2457-465b-b17a-2d9dc30540b3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.291292 Aug 24 03:35:29.934176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 138/282] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:29 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:30.972335 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:30.973580 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:30.986078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.986902 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.987659 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:30.988919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.989716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.990475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.225065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:31.241352 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-22836df2-c4e2-4f92-ab7f-26b47a19bd0a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.278094 Aug 24 03:35:31.242386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 145/283] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:30 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:31.264121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:31.265593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:31.274303 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.275068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.275604 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.277051 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.277724 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.278262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.320568 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b635cf71-2b88-4275-84a2-20266505b757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/ips" status: 200 len: 152 microversion: 2.20 time: 0.060414 Aug 24 03:35:31.322244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 139/284] 10.222.0.78 () {60 vars in 1289 bytes} [Wed Aug 24 03:35:31 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/ips => generated 152 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:35:32.145890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0c52a8e9-3bfa-4d16-ad8e-f1ad6bb53d7e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:32.154108 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0c52a8e9-3bfa-4d16-ad8e-f1ad6bb53d7e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:32.154814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0c52a8e9-3bfa-4d16-ad8e-f1ad6bb53d7e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:32.155318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0c52a8e9-3bfa-4d16-ad8e-f1ad6bb53d7e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:32.232668 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0c52a8e9-3bfa-4d16-ad8e-f1ad6bb53d7e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Going to try to stop instance {{(pid=127257) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:35:32.283613 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:32.284510 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:32.296198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:32.297064 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:32.297807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:32.299289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:32.300063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:32.300755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:32.309844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0c52a8e9-3bfa-4d16-ad8e-f1ad6bb53d7e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action" status: 202 len: 0 microversion: 2.1 time: 0.167746 Aug 24 03:35:32.311816 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 146/285] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:35:32 2022] POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:32.329003 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:32.330568 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:32.345302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:32.346351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:32.347200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:32.348509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:32.349306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:32.350250 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:32.385533 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:32.596905 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:32.613826 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-167c10ff-fbd8-4b2c-a7ab-be851d0a6984 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.334219 Aug 24 03:35:32.615008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 140/286] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:32 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:32.637671 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:32.648330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3b2e90dc-22e5-4490-97de-e45b0dbf24a9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.327349 Aug 24 03:35:32.649013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 147/287] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:32 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:33.642022 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:33.643043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:33.650853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.651377 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.651817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.652594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.653449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.653996 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.676868 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:33.678680 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:33.688771 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.689727 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.690442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.691715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.692780 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.693457 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.914589 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:33.926275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-61575f8f-2c61-4385-afd8-50334ef6bdf8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.288723 Aug 24 03:35:33.927803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 141/288] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:33 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:33.984690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:33.996812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-28eb847c-f7c7-496b-908a-6845ed2e9d8f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.324353 Aug 24 03:35:33.997588 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 148/289] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:33 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:34.954058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:34.955011 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:34.962416 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.962981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.963426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:34.964147 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.964604 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.965077 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:34.968340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:35.033204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:35.033912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:35.043494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:35.044006 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:35.044448 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:35.045201 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:35.045666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:35.046109 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:35.233471 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:35.243523 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e6da9d9e-368f-42ea-bd0a-33c0c3385e24 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.294479 Aug 24 03:35:35.244566 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 142/290] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:34 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:35.285673 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:35.300667 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fbffd66d-ac5b-4429-8408-8207191c3451 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.274217 Aug 24 03:35:35.301272 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 149/291] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:35 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:35.835790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:35.836361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:35.843336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:35.843939 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:35.844401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:35.845120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:35.845587 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:35.846017 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:35.877668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lazy-loading 'flavor' on Instance uuid aaca649f-ad0a-4355-b741-7e46388c74cd {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:36.137210 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-65ffdc86-733d-49bc-9822-1575506f9821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/action" status: 202 len: 0 microversion: 2.20 time: 0.304823 Aug 24 03:35:36.138262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 143/292] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 24 03:35:35 2022] POST /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:35:36.149306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.150893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.162263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.163073 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.163794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.164785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.165674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.166254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.273427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.274875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.290991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.291916 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.292728 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.293950 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.294709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.295369 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.582469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.587466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.591843 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.593431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.595539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7636e185-ccf6-4ccb-a7cd-fcc14200a12a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.450325 Aug 24 03:35:36.596119 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 150/293] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:36.601296 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.601532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6eada56f-2c1d-4c18-80ca-2e320be06c99 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.336725 Aug 24 03:35:36.602295 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.602428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 144/294] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:36.615910 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.616482 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.616985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.617765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.618224 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.618764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.769646 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.778891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2daba358-bfc9-42e0-a59c-e86ed874f180 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.181332 Aug 24 03:35:36.779486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 151/295] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:37.626491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.627240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.637209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.638197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.639565 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.640386 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.641378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.642977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.643790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.644502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.646982 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.647664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.648192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.649163 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.649721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.650315 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.979755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:37.989296 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:37.990467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d6c50dc9-530b-4760-9de7-59dd6fbee374 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.368833 Aug 24 03:35:37.991233 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 145/296] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:38.001093 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:38.002256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:38.005669 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.009082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.011332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-53af18df-c2c2-4205-bdd0-1e24303d3443 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.380507 Aug 24 03:35:38.022699 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 152/297] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:38.022957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.022957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.022957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.022957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.023260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.023260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.196756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.206338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-79ce9d4f-ba2c-4ebd-a071-6aaebb3f353f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.213675 Aug 24 03:35:38.207064 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 146/298] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:39.026154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:39.026987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:39.035009 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.035508 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.035963 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.036677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.037278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.037570 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.047478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:39.048634 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:39.057293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.057975 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.058450 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.059427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.059898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.060330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.415637 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:39.430710 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:39.431680 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7dede05e-cadb-4dbd-9d20-39e02838584c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.409748 Aug 24 03:35:39.432686 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 153/299] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:39 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:39.442712 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:39.443729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:39.446878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:39.449890 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:39.452372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-66bec9a1-7796-4679-acb3-2f54ae34d9ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.410764 Aug 24 03:35:39.454231 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 147/300] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:39 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:39.458056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.459302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.460776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.461726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.462540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.463449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.689872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:39.710357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dc66f25b-5db7-48c1-9c9a-36e02178abac tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.275819 Aug 24 03:35:39.711609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 154/301] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:39 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:40.469326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:40.470248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:40.479624 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.480081 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.480530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.481289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.481756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.482188 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.489551 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:40.490497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:40.502981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.507923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.508759 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.511577 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.512367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.512991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.791276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.815522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e3da067f-ffbb-48c0-b7a4-918a1d1d23d5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.350611 Aug 24 03:35:40.816617 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 148/302] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:40 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:40.824066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.826235 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:40.827592 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:40.841043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.841395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.842091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.842862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.844212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.845183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.845183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.845777 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.846284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-45ba5546-3795-4a80-90b2-538299580131 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.363726 Aug 24 03:35:40.847712 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 155/303] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:40 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:41.056028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:41.066824 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9f2f68e5-6729-4c35-a93f-88958e5e3926 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.248598 Aug 24 03:35:41.067593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 149/304] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:40 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:41.842437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:41.843070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:41.854377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.854897 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.855625 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.856882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.857710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.858428 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.872024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:41.872657 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:41.881051 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.881646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.882141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.883007 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.883557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.884074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:42.128267 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.140690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-376afacc-8535-40d3-bc2c-9a0e0d156fce tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.301951 Aug 24 03:35:42.141406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 156/305] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:41 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:42.146828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:42.147586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:42.149890 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.155998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:42.156628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:42.157409 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:42.158859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:42.159062 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:42.159590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:42.166021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.168953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.171500 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c524e078-7c60-423f-ae61-afa84fb1647d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.303841 Aug 24 03:35:42.173826 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 150/306] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:41 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:42.367079 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.381054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-129f560a-39a6-472b-8f67-537e9f148070 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.238181 Aug 24 03:35:42.381882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 157/307] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:42 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:43.026769 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df3d8848-3cb2-4415-889a-e65cc9f1f8fd", "device": "/dev/sdb"}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:43.030044 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.039741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.040305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.040810 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.041617 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.042261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.042812 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.166494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.167752 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.171987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=42 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:43.182338 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.183248 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.184024 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.185303 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.186459 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.187331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.396607 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.410273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0bd08862-e4d9-4d02-bb2e-78565870e41d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.251400 Aug 24 03:35:43.410978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 158/308] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:43.416912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.417757 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.426454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.427017 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.427468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.428229 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.428710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.429295 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.613828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.625941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.627816 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.629051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cb0dcaff-eb7d-4be4-a715-6ea1bf4b4772 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.216593 Aug 24 03:35:43.629631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 159/309] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:43.635711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.636791 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.645900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.646471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.647105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.647917 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.648360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.649041 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.854972 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.866410 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2c69a864-7a7a-428a-a793-27645b679dfb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.235548 Aug 24 03:35:43.867257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 160/310] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:44.043047 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7091921d-3f52-47a0-b492-9c0b99c60e6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "POST /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020412 Aug 24 03:35:44.044335 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 151/311] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:35:43 2022] POST /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:44.436946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:44.437928 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:44.447488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.448124 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.448694 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.449746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.450375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.451131 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.630146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:44.639973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-694c7592-c75d-41a2-8521-357b7b88f381 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1522 microversion: 2.1 time: 0.208910 Aug 24 03:35:44.640796 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 161/312] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:44 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:44.662091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:44.663258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:44.674953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.675789 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.676550 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.677875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.678843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.679599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.896057 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:44.897167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:44.904891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:44.914713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.915326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:44.915625 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.916322 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.917360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:44.917565 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.918151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.919449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.919663 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-299b7d7c-ef2a-429b-bfb1-98a4ef110640 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.264808 Aug 24 03:35:44.920285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 152/313] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:44 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:45.111857 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:45.129299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0daefb78-893e-48f1-b54d-207355acec0d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.237641 Aug 24 03:35:45.130549 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 162/314] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:44 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:45.668472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.669607 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.682490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.683401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.684138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.685383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.686504 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.687517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.872612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:45.882824 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ba856596-119b-4137-9ab6-9fea4b131de5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1502 microversion: 2.1 time: 0.221149 Aug 24 03:35:45.883517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 153/315] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:45 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:45.911137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.912222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.925004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.925505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.925939 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.926758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.927221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.927651 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.947578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.948076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.958407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.959583 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.960669 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.961701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.962976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.963458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.166125 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:46.182473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:46.190913 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-00f56dfa-9c4a-40d1-89da-cbc517334b9b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1515 microversion: 2.1 time: 0.287763 Aug 24 03:35:46.192494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 163/316] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:45 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:46.197474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:46.199474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:46.206227 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:46.208002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:46.209462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6ca858a5-d441-4836-b341-c8cbd214c39b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.267090 Aug 24 03:35:46.209844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.210309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 154/317] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:45 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:46.221001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.222309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.223955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.225424 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.227755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.239673 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:46.529864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:46.544814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5a5f531c-79b9-4e76-ba5d-24e139bff54b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.351012 Aug 24 03:35:46.546496 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 164/318] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:46 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:47.265393 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:47.266775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:47.281119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.282018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.282943 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.284281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.285122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.285909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.316002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:47.581417 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:47.582779 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:47.601386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.602280 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.603137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.604447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.605292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.606081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.892433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:47.917046 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:47.921049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:47.923816 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-555bfa4b-5e2c-4254-a5d4-4b2d3c47afd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.666451 Aug 24 03:35:47.924901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 155/319] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:47 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:47.953268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:47.973473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e9aadb93-25fe-4762-800c-b8aa934525db tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1723 microversion: 2.1 time: 0.400888 Aug 24 03:35:47.974770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 165/320] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:47 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:48.740885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "df3d8848-3cb2-4415-889a-e65cc9f1f8fd", "create_info": {"type": "qcow2", "new_file": "volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.3230a1f5-81ba-4d4d-b9d2-7aa95f9febfc.vhdx", "snapshot_id": "3230a1f5-81ba-4d4d-b9d2-7aa95f9febfc"}}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:48.755605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97a45c54-1fe5-4470-83ef-9fef2d361903(cell1) {{(pid=127258) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 03:35:48.756489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.757221 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.758083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.812464 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.813236 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.814022 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.858988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-298f1a16-613e-4075-96c8-4067e9db055f req-87e7490e-d282-4116-bc95-2b13d120d1de admin admin] 10.222.0.79 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.295990 Aug 24 03:35:48.860332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 156/321] 10.222.0.79 () {64 vars in 1326 bytes} [Wed Aug 24 03:35:48 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:35:48.957562 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:48.959679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:48.969718 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:48.972005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.973242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.974020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.974413 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:48.975425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.976336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.977087 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.988055 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.988994 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.989806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.991088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.991904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.992584 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.037199 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lazy-loading 'flavor' on Instance uuid c14a955e-8274-4ad0-af0d-a9e41d7bade7 {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:49.149360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-39a77892-f953-400f-8dee-371b51c029f3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7/action" status: 200 len: 32 microversion: 2.1 time: 0.188228 Aug 24 03:35:49.150779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 157/322] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:35:48 2022] POST /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:35:49.163878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:49.164529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:49.174725 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.175359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.176281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.178124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.178124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.178906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.225243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.235507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.237083 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.238347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6fbb3d5f-e346-4df0-be33-94264132917f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.289018 Aug 24 03:35:49.238991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 166/323] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:48 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:49.244572 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:49.245255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:49.252504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.252994 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.253433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.254135 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.254620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.255082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.516631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.527254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4a12d2a4-97b1-40d1-8e03-c9e2ee326daf tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1700 microversion: 2.1 time: 0.370932 Aug 24 03:35:49.527904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 158/324] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:49 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1700 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:49.554359 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.555154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ddfd0dc1-3e9b-47cb-a391-7afc71049e38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:49.563710 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd0dc1-3e9b-47cb-a391-7afc71049e38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.564490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd0dc1-3e9b-47cb-a391-7afc71049e38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.565483 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd0dc1-3e9b-47cb-a391-7afc71049e38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.569277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-68b16b88-8215-4a84-8b49-6fb500412eb3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.328807 Aug 24 03:35:49.570224 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 167/325] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:49 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:49.648295 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ddfd0dc1-3e9b-47cb-a391-7afc71049e38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Going to try to start instance {{(pid=127258) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:35:49.712753 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ddfd0dc1-3e9b-47cb-a391-7afc71049e38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action" status: 202 len: 0 microversion: 2.1 time: 0.163403 Aug 24 03:35:49.713366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 159/326] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:35:49 2022] POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:49.723830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:49.724610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:49.732081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.732800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.734787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.735276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.735689 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.736400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.922271 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.938236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f3d3b4ac-2c19-4436-880a-35d5ab23e7dc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1709 microversion: 2.1 time: 0.219375 Aug 24 03:35:49.939330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 168/327] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:49 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1709 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:50.264626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:50.265621 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:50.273662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.274170 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.274608 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.275389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.275868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.276275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.448487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:50.460119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:50.462204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:50.463695 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-dd7b99da-7aee-4173-9421-8223a7abedb6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.203871 Aug 24 03:35:50.464430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 160/328] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:50 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:50.603843 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:50.604678 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:50.612403 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.612906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.613346 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.614084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.614613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.615083 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.789212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:50.799986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4a5c615e-2b91-444f-8f11-37e38708c7cc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.200173 Aug 24 03:35:50.800605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 169/329] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:50 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:50.977713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:50.978847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:50.991081 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.991980 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.992754 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.993965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.994794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.995548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.176158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:51.186143 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fd7d42f1-58dc-43fd-a268-47b6b2a109d5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1709 microversion: 2.1 time: 0.215120 Aug 24 03:35:51.186909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 161/330] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:50 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1709 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:51.495563 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:51.496217 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:51.503722 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.504209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.504639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.505356 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.505788 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.506219 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.703362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:51.718995 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:51.721873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:51.723994 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ff6cb08b-ffc2-4637-8430-aae736e72360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.232282 Aug 24 03:35:51.725147 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 170/331] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:51 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:51.825585 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:51.826392 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:51.836972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.838073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.838827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.839998 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.841925 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.842680 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.070169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:52.085988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d12b9ba9-2d48-40cf-a842-bcd54289e356 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.264531 Aug 24 03:35:52.087234 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 162/332] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:51 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:52.209363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:52.210099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:52.217363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.217906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.219176 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.220155 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.220659 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.221122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.255208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:52.255903 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:52.263986 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.264594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.265092 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.265811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.266264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.266713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.297079 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-eb5e0633-1f50-4ed9-bec8-b4a84e540850 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/ips" status: 200 len: 149 microversion: 2.1 time: 0.045992 Aug 24 03:35:52.297959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 163/333] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:35:52 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:52.457695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:52.468292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1d38c0d4-097a-48b8-b08c-f38a1176a743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1709 microversion: 2.1 time: 0.263030 Aug 24 03:35:52.469225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 171/334] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:52 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:52.780105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:52.781134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:52.793799 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.794712 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.795490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.797236 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.798139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.799112 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.059884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:53.076524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:53.080335 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:53.083243 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c667dbc0-39cc-4205-a7c0-0fd7836516e4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.320704 Aug 24 03:35:53.084264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 164/335] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:52 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:53.122082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:53.123093 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:53.148114 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.148114 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.148114 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.149241 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.159993 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.160781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.350806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:53.364154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9c3e0ec1-7ce2-4671-a079-38c820fd3321 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.248553 Aug 24 03:35:53.364154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 172/336] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:53 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:53.507855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:53.509107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:53.518229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.519366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.520056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.520983 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.521718 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.522400 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.744686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:53.755570 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c7a4f1ad-e4e3-4af7-8287-effc06e08711 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1709 microversion: 2.1 time: 0.253800 Aug 24 03:35:53.756238 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 165/337] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:53 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:53.858331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d1d77aa-0e09-41ec-94cd-dee2be33ed75"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:53.861228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:53.868412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.869036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.869798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.870627 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.871137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.871607 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.123440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:54.124567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:54.128754 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=62 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:54.136512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.137063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.137668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.138567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.139126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.139602 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.358137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:54.389965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:54.393620 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:54.396066 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3e3c25a4-6cce-47e9-9bb8-3608817c794b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.277455 Aug 24 03:35:54.397335 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 166/338] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:54 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:54.411795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:54.413322 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:54.432484 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.433354 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.434175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.436529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.437671 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.438434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.650204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ffee6e51-d836-4ad4-b5df-b21207f6bddf tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796241 Aug 24 03:35:54.651263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 173/339] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:35:53 2022] POST /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:54.678896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:54.693647 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-29ebaedc-5c43-4813-9b27-ef83b2b35885 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.294404 Aug 24 03:35:54.693647 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 167/340] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:54 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:54.781837 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:54.782866 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:54.792385 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.793069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.793665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.794512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.795120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.795890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.009075 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "df3d8848-3cb2-4415-889a-e65cc9f1f8fd", "create_info": {"type": "qcow2", "new_file": "volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.6fe06d6b-9fd2-4539-b87c-64b670f0af56.vhdx", "snapshot_id": "6fe06d6b-9fd2-4539-b87c-64b670f0af56"}}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:55.016040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.016886 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.017957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.022089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:55.034537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.035375 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.036114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.038354 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-64e7ade6-9184-48f7-9238-4ec41e34dea5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1709 microversion: 2.1 time: 0.262665 Aug 24 03:35:55.039372 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 174/341] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:54 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:55.062627 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-baa20f26-c7c8-4b8c-963e-2f9ede7af3af req-65231e04-3bae-41a1-a03b-cbc3cdae906f admin admin] 10.222.0.79 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.162838 Aug 24 03:35:55.064111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 168/342] 10.222.0.79 () {64 vars in 1326 bytes} [Wed Aug 24 03:35:54 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:35:55.441730 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:55.442836 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:55.455460 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.456330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.457100 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.458530 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.459351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.460584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.666306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:55.676907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:55.679021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:55.680512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-132ed649-f349-4113-947b-89c2b42d3ca6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.246397 Aug 24 03:35:55.681336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 175/343] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:55 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:55.730352 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:55.731393 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:55.739992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.740631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.741188 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.742022 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.742610 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.743187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.948848 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:55.958375 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-be088d6a-d459-489f-9f9c-e850c5f265d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.233050 Aug 24 03:35:55.959068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 169/344] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:55 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:56.073184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:56.074319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:56.085638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.086328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.087021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:56.088284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.089043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.089536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:56.298675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:56.308636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2aa67c79-64d2-4772-b33d-27ad9addd120 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1709 microversion: 2.1 time: 0.239732 Aug 24 03:35:56.312416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 176/345] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:56 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:56.710033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:56.711443 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:56.720190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.721064 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.724642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:56.724642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.724642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.724642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:56.957903 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:56.962193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:56.975590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:56.978530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:56.980466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-614a4069-dec9-437d-bad5-440a02925af5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.277676 Aug 24 03:35:56.981317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:56.981954 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 170/346] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:56 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:56.982133 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:56.990955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.991461 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.991906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:56.992636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.993100 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.993520 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:57.179901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:57.196576 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6650186b-a06d-44ca-80f5-577ae39d280a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.218753 Aug 24 03:35:57.198269 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 177/347] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:56 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:57.334056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:57.334758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:57.343402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:57.344034 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:57.344446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:57.345219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:57.345756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:57.346231 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:57.526939 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:57.536705 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9560d24d-dff1-4a25-ac73-3b163c8192ad tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1713 microversion: 2.1 time: 0.206776 Aug 24 03:35:57.537353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 171/348] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:57 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1713 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:58.018298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:58.019353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:58.029099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.029981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.030839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.032505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.033242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.033820 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.228965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:58.231662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:58.246546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.247840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.249152 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.250906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.252573 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.253522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.308770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:58.320902 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:58.322888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:58.324587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-301b4f62-7e3d-48ff-9d16-c47986700c4f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.312443 Aug 24 03:35:58.325732 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 178/349] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:58 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:58.490031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:58.502454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f9b7d464-9643-4a6e-957b-c1803ee653f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.283853 Aug 24 03:35:58.503827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 172/350] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:58 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:59.367298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:59.368674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:59.377159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.377883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.378513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.379468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.380004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.380513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.401507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:59.542621 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:59.544166 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:59.555886 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.556741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.557472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.558280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.558930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.559360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.649361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:59.661427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:59.663382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:59.664735 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f515292c-7365-4f41-812a-629ef2ff64f1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.303740 Aug 24 03:35:59.665820 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 179/351] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:59 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:59.807382 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:59.821760 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c5073fd9-9f2c-4b00-a00e-20cebb71082c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.286520 Aug 24 03:35:59.824453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 173/352] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:59 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:00.313808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-107d5579-ae4d-4237-a144-b01a308a2e64 req-b97e45ef-ffb8-4536-b246-6e541f7059e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaca649f-ad0a-4355-b741-7e46388c74cd", "name": "network-vif-plugged", "status": "completed", "tag": "f8a2d888-1c8d-4395-a171-9a83d1745a85"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:00.324577 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-107d5579-ae4d-4237-a144-b01a308a2e64 req-b97e45ef-ffb8-4536-b246-6e541f7059e5 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:00.325061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-107d5579-ae4d-4237-a144-b01a308a2e64 req-b97e45ef-ffb8-4536-b246-6e541f7059e5 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:00.325695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-107d5579-ae4d-4237-a144-b01a308a2e64 req-b97e45ef-ffb8-4536-b246-6e541f7059e5 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:00.340667 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-107d5579-ae4d-4237-a144-b01a308a2e64 req-b97e45ef-ffb8-4536-b246-6e541f7059e5 service nova] Creating event network-vif-plugged:f8a2d888-1c8d-4395-a171-9a83d1745a85 for instance aaca649f-ad0a-4355-b741-7e46388c74cd on hv-cinder-85426 Aug 24 03:36:00.347992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-107d5579-ae4d-4237-a144-b01a308a2e64 req-b97e45ef-ffb8-4536-b246-6e541f7059e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038399 Aug 24 03:36:00.348946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 180/353] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:00.703590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:00.704665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:00.725390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:00.726124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:00.727020 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:00.727883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:00.728879 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:00.729414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:00.873737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:00.874925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:00.884281 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:00.885321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:00.886246 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:00.898641 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:00.899483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:00.899953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:01.004806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:01.029599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:01.034316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:01.037118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4d5a7869-d94f-4ca1-89dd-f8ca1dbe212f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.337789 Aug 24 03:36:01.038533 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 174/354] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:00 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:01.144120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:01.159683 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-95242311-143e-42d9-99fb-c6ecc424245b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.305913 Aug 24 03:36:01.160642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 181/355] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:00 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:02.076305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:02.077298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:02.101496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.101496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.101496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.101496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.102429 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.102429 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.183940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:02.184632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:02.192426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.192922 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.193779 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.194039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.194505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.194958 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.286038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:02.295598 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:02.297838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:02.299164 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b486078d-04f5-4b5f-b104-06b9b10be45a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.227373 Aug 24 03:36:02.299739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 175/356] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:02 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:02.369860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:02.380036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-95508ee8-9a5e-4889-8738-40506287e9fe tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.200811 Aug 24 03:36:02.380736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 182/357] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:02 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:02.509398 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b9025f5e-88b6-4926-800f-5b26d11009ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: .version_select at 0x7f4f44d4f310>, body: {"keypair": {"name": "tempest-keypair-345673604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARLPk0xZkSCeWTXpv5DYuTQ9Daf6I7GpIL/V2+6xfqQoZAlnCgzUjbftYZMtBBKK/hTVUf/nZcSkJKYQaVVuLyAFuoo4vAbq5t9PWbvknQvzmS8Ar0lGL18nqH3AEjQyg=="}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:02.531978 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-b9025f5e-88b6-4926-800f-5b26d11009ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:02.536906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-b9025f5e-88b6-4926-800f-5b26d11009ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:02.584662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b9025f5e-88b6-4926-800f-5b26d11009ba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079063 Aug 24 03:36:02.585538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 176/358] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:36:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:02.631634 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "df3d8848-3cb2-4415-889a-e65cc9f1f8fd", "create_info": {"type": "qcow2", "new_file": "volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.32656e20-76f9-4a9c-be59-7255d6413da6.vhdx", "snapshot_id": "32656e20-76f9-4a9c-be59-7255d6413da6"}}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:02.641036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97a45c54-1fe5-4470-83ef-9fef2d361903(cell1) {{(pid=127257) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 03:36:02.641493 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.641994 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.642410 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.686534 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.687454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.687931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.714264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-fef7bd75-6005-428f-a0c1-6609efaf24c1 req-0e76efd8-d431-4e70-be19-77f6df8ab4cb admin admin] 10.222.0.79 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.165116 Aug 24 03:36:02.714968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 183/359] 10.222.0.79 () {64 vars in 1326 bytes} [Wed Aug 24 03:36:02 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:36:03.323757 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:03.324814 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:03.335508 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.336358 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.337129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.338409 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.339265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.340041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.412973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:03.414243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:03.426550 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.427451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.428225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.429549 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.430308 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.431127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.624804 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:03.633990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:03.636228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:03.637306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-29deb057-81d2-4d44-a063-129249438cc1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.318349 Aug 24 03:36:03.637893 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 177/360] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:03 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:03.685546 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:03.699775 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9622e4f7-07aa-4b33-b888-21ac025630a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.296597 Aug 24 03:36:03.700620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 184/361] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:03 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:04.516123 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-125523641", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f5f140-61b8-4d93-a685-1b439b420020"}], "security_groups": [{"name": "tempest-securitygroup--1993076355"}], "key_name": "tempest-keypair-345673604", "user_data": "}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:04.647963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] validate_networks() for [('f9f5f140-61b8-4d93-a685-1b439b420020', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:04.667288 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:04.668493 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:04.681008 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.681893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.682783 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:04.684103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.684973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.686091 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.021970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:05.024862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=4 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:05.037211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:05.040273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:05.042361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c2a7e492-6c77-4b5d-872c-f341c68543dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.382874 Aug 24 03:36:05.043417 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 185/362] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:04 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:05.052178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:05.053224 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:05.065587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.066411 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.067212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.068656 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.069817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.070556 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.362062 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:05.376195 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ac47cf30-c340-4592-81b3-56d0fce44b3e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.331170 Aug 24 03:36:05.377270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 186/363] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:05 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:05.399737 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:05.400463 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:05.401484 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:05.402228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:05.402999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:05.420012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.421020 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.422093 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.423602 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.424429 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.425195 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.460698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:05.469780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:05.493003 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:05.497779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:05.565969 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-21c5f47e-ffbe-448e-bac9-c5e169cf8ebb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.056316 Aug 24 03:36:05.567057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 178/364] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:36:05.589068 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-388eafa5-d9bd-40d9-8321-b2c07f2d30a0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:05.590232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-388eafa5-d9bd-40d9-8321-b2c07f2d30a0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:05.686466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-388eafa5-d9bd-40d9-8321-b2c07f2d30a0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:05.698524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-388eafa5-d9bd-40d9-8321-b2c07f2d30a0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1240 microversion: 2.1 time: 0.118677 Aug 24 03:36:05.699255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 187/365] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:05 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:06.088303 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:06.090196 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:06.102022 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.102979 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.103814 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.105103 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.105936 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.106806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.298848 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.315357 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.318387 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.320830 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b139e50f-1104-4986-b651-f4cf956b5f26 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.244081 Aug 24 03:36:06.321860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 179/366] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:06 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:06.413219 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:06.414764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:06.426795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.427701 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.428462 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.429727 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.430552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.431598 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.673550 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.684677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-450919d6-3adb-4e34-9d1b-d7979b4c8e90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.277669 Aug 24 03:36:06.685655 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 188/367] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:06 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:06.723588 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:06.724224 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:06.731725 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.732225 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.732687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.733535 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.734008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.734455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.810533 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.824563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7c77452b-bf22-4260-a398-c5ee27868155 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1244 microversion: 2.1 time: 0.106132 Aug 24 03:36:06.825869 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 180/368] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:06 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:07.358413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.359299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:07.366473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.367013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.367453 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.368178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.368639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.369069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.559512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:07.572290 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:07.574090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:07.575590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a8f9ae2a-f7bf-466a-81c8-362194c95201 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.221687 Aug 24 03:36:07.576313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 189/369] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:07 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:07.650477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.654339 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.655041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.655586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.668399 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.669142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.669740 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.701804 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-df207bf7-e3d5-468c-99e2-7c0950677d40 req-85bed795-6d92-4ffc-8708-94a21d787688 admin admin] 10.222.0.79 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3230a1f5-81ba-4d4d-b9d2-7aa95f9febfc?delete_info=%7B%22file_to_merge%22:%20%22volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.3230a1f5-81ba-4d4d-b9d2-7aa95f9febfc.vhdx%22,%20%22volume_id%22:%20%22df3d8848-3cb2-4415-889a-e65cc9f1f8fd%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.116609 Aug 24 03:36:07.702973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 181/370] 10.222.0.79 () {62 vars in 1800 bytes} [Wed Aug 24 03:36:07 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3230a1f5-81ba-4d4d-b9d2-7aa95f9febfc?delete_info=%7B%22file_to_merge%22:%20%22volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.3230a1f5-81ba-4d4d-b9d2-7aa95f9febfc.vhdx%22,%20%22volume_id%22:%20%22df3d8848-3cb2-4415-889a-e65cc9f1f8fd%22%7D => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:36:07.722236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.724081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:07.738895 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.741213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.742364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.750930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.752036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.753066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.853133 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.855698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:07.871507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.872349 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.873127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.874913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.875737 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.876464 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.012505 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.032885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-71cf85fd-4979-4b6f-a5cc-157f0b3f2725 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1244 microversion: 2.1 time: 0.189008 Aug 24 03:36:08.047362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 182/371] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:07 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1244 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:08.064290 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.073546 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2d867593-05f6-4a3a-8484-bb64ca3e5a90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.358840 Aug 24 03:36:08.074184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 190/372] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:07 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:08.611013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:08.612599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:08.628172 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.629189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.630071 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.631772 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.632631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.633659 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.864338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.882591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.885910 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.888303 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4304e121-6e52-41f8-9ed6-4c4fa440654d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1745 microversion: 2.20 time: 0.288343 Aug 24 03:36:08.889355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 183/373] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:08 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1745 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:09.076347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:09.077036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.084690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.085182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.085619 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.086356 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.086850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.087299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.110018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:09.110874 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.122228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.123132 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.123941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.125372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.126167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.127014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.160714 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:36:09.161027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:36:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 (ip 10.222.0.78) !!! Aug 24 03:36:09.181620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:09.190894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cd10051e-05b8-4f75-865a-42a8d91319cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1244 microversion: 2.1 time: 0.127859 Aug 24 03:36:09.198508 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 191/374] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:09 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1244 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:09.302626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:09.312673 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e53fbbb5-a566-40ae-9a21-1176a8dfc551 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.207340 Aug 24 03:36:09.313573 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 184/375] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:09 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:09.931488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:09.932125 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.940530 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.941706 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.942391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.943884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.944648 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.945241 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.176770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:10.188486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:10.190151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:10.191406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7836f344-9c00-4676-800d-4b1e1e0f3e9c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.266185 Aug 24 03:36:10.191974 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 192/376] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:09 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:10.226044 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:10.227120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:10.239062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.240329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.241161 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.242762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.243664 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.244397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.335957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:10.336522 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:10.345304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:10.345717 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.346342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.346918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.347654 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.348276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.348907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.356219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f0229f97-0ec1-4d32-b8f1-bc23c0810307 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1236 microversion: 2.1 time: 0.138328 Aug 24 03:36:10.357056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 185/377] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:10 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1236 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:10.532166 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:10.545544 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-604b2566-0101-407a-a5a1-bb4194f92fda tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.213472 Aug 24 03:36:10.556370 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 193/378] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:10 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:11.220403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:11.221282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:11.232644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.233699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.234767 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.235461 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.236149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.236855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.398218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:11.401041 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:11.416547 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.417969 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.418907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.420431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.421349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.422084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.470930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:11.488248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:11.493170 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:11.495557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-61d278a5-4275-4317-af9c-7a14a39ebd32 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.282010 Aug 24 03:36:11.496648 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 186/379] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:11 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:11.535226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:11.548993 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d21e90f5-5006-4c1a-b716-bac1e73d7f4a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1292 microversion: 2.1 time: 0.160362 Aug 24 03:36:11.549536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 194/380] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:11 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1292 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:11.573867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:11.574800 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:11.585871 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.586701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.588010 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.589184 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.589951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.590696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.835035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:11.847366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5cc718d6-53cc-4dc8-9cf3-5712221c577f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.278622 Aug 24 03:36:11.850603 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 187/381] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:11 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:12.525431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:12.526687 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:12.537611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.538682 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.539278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.540200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.540769 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.541317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.588858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:12.591212 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:12.607746 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.609515 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.610546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.613050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.614391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.615371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.678343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:12.789513 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:12.813929 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4807686f-17cd-41cc-8ba7-f3c9f0bb904c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1292 microversion: 2.1 time: 0.234504 Aug 24 03:36:12.834871 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 188/382] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:12 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1292 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:12.884117 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:12.887173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:12.899921 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.900934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.904593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:12.916839 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.920137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.920631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:12.923527 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:12.923783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.925036 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.925655 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-95a92f33-48c5-461e-9752-69f77c4001e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.406298 Aug 24 03:36:12.926811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 195/383] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:12 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:13.127156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.131105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:13.141050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fc840969-7ad1-4852-bff3-8ee126e8fc37 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1501 microversion: 2.1 time: 0.268644 Aug 24 03:36:13.142308 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 189/384] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:12 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:13.183671 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "324f445f-d1d0-483f-8b19-f690ddc7e91b"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:13.197868 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.201174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=78 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:13.220078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.221495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.222790 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.224515 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.225726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.227023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.277428 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] HTTP exception thrown: Cannot 'attach_volume' instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 while it is in vm_state rescued Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Request method failure captured: Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: POST /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7/os-volume_attachments HTTP/1.1 Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 74 Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZxAowYte1TnzkDC8E2BasP9nMh2qq3z0g6gLyXb4nCQOnft_YpKkhFXsYfauzVNMVRH3PUGTE25tn_8om-ND_s8ozoAvNgNctUS5PPDyME0f3EMBA398lqiTmDKCBU6tAHG7rKiyW0my49b3YO0CTLY9nfzNjyfDim3bydBtSaqdU4 Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:36:13.281523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66a102abeb7f46a292a49d1f022190e7"}]}] Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: ae4f7f8855b5445d863a825ce921c982 Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {"volumeAttachment": {"volumeId": "324f445f-d1d0-483f-8b19-f690ddc7e91b"}} Aug 24 03:36:13.282968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Cannot 'attach_volume' instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 while it is in vm_state rescued Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'server_id': 'c14a955e-8274-4ad0-af0d-a9e41d7bade7', 'body': {'volumeAttachment': {'volumeId': '324f445f-d1d0-483f-8b19-f690ddc7e91b'}}} Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:13.283746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 while it is in vm_state rescued Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:13.284907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:13.294711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:13.294711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:13.294711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 while it is in vm_state rescued Aug 24 03:36:13.294711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:36:13.294711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Returning 409 to user: Cannot 'attach_volume' instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 while it is in vm_state rescued {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:13.294711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-19695a45-f8ae-4f86-88cc-cef04db39d0e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121929 Aug 24 03:36:13.294711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 196/385] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:36:13 2022] POST /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7/os-volume_attachments => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:36:13.300070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:13.301035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.313628 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.314518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.315338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.316612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.317451 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.318288 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.453441 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-18c06ad0-d510-477c-93a8-9af60568f445 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7/action" status: 202 len: 0 microversion: 2.1 time: 0.160546 Aug 24 03:36:13.454251 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 190/386] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:36:13 2022] POST /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:36:13.464908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:13.466604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.476622 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.477329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.477984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.479418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.480191 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.480777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.700401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.737674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fdedc2ad-716d-4589-af6b-1ac7369a17f5 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1509 microversion: 2.1 time: 0.274941 Aug 24 03:36:13.740986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 197/387] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:13 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:13.860346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:13.863801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.912308 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.913901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.914755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.916211 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.916975 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.917866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.974712 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:13.975533 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.989357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.991628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.993131 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.994645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.995807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.997132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.053384 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.073262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e72d1662-6b08-4e99-8547-4e4a2dd1317e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1300 microversion: 2.1 time: 0.220764 Aug 24 03:36:14.074982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 191/388] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:13 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1300 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:14.487379 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.490012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:14.503294 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.505326 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.506773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d673422a-452b-4412-9d2f-9ac13e3e39cd tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.538585 Aug 24 03:36:14.507906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 198/389] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:13 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:14.819976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:14.821516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:14.831209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.832042 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.832769 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.833840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.834543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.835203 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.115367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:15.120047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:15.136616 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.147638 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6f5c9d19-0f08-48a5-8b48-39a276397d28 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1509 microversion: 2.1 time: 0.335663 Aug 24 03:36:15.148599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 192/390] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:14 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:15.156269 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.158639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.160656 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.173997 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.179383 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.180650 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.461271 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.482014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=10 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:15.493498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b1b30ce6-3f75-4ce0-bfe3-85a1c86a116b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1298 microversion: 2.1 time: 0.389884 Aug 24 03:36:15.502570 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 199/391] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:15 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1298 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:15.570995 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:15.576206 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:15.610820 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.621125 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.626996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.630491 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.635809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.638386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.730885 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:15.867512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:15.886574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.887894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.893126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.916373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.917265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.918156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.948208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-e9779050-3c8f-4076-b69f-6d6157da6d3a req-ec991a4d-b7b4-4f8a-a63f-97512d75e504 admin admin] 10.222.0.79 "DELETE /compute/v2.1/os-assisted-volume-snapshots/32656e20-76f9-4a9c-be59-7255d6413da6?delete_info=%7B%22file_to_merge%22:%20%22volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.32656e20-76f9-4a9c-be59-7255d6413da6.vhdx%22,%20%22volume_id%22:%20%22df3d8848-3cb2-4415-889a-e65cc9f1f8fd%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.570009 Aug 24 03:36:15.951473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 193/392] 10.222.0.79 () {62 vars in 1800 bytes} [Wed Aug 24 03:36:15 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/32656e20-76f9-4a9c-be59-7255d6413da6?delete_info=%7B%22file_to_merge%22:%20%22volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.32656e20-76f9-4a9c-be59-7255d6413da6.vhdx%22,%20%22volume_id%22:%20%22df3d8848-3cb2-4415-889a-e65cc9f1f8fd%22%7D => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:36:16.188406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.199819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:16.201120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:16.214783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.215361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.217399 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.218986 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.219976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.220682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.221556 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.221791 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.228431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3a0dcc40-d084-4b1e-92de-539e312c997f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.665752 Aug 24 03:36:16.229492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 200/393] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:15 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:16.542794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:16.544479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:16.575890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.578048 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.582442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.587772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.588824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.592489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.077232 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:17.097197 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-05324a63-4e76-4621-bb07-5f6fec03a3f9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1509 microversion: 2.1 time: 0.903828 Aug 24 03:36:17.117230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 194/394] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:16 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1509 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:17.263980 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:17.265692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:17.289751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.290642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.291465 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.292794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.293621 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.294411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.373662 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:17.400928 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-db95bbd7-992a-4e1e-8656-8b7b6bffac5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.865377 Aug 24 03:36:17.401925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 201/395] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:16 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:17.750370 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:17.775770 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:17.781893 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:17.783836 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ad626dac-5831-4d0e-9ca8-269da6a4c6c4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.526232 Aug 24 03:36:17.786536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 195/396] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:17 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:18.126931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:18.127805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:18.152754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.153282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.153754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.154546 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.155091 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.155579 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.388728 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-3a4ac13d-33c1-450b-94d5-932d25567d06 req-fac89032-7eea-4ad3-8e66-e76817977cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ca164a-c24d-4225-89e6-d5718d7e88b4", "tag": "03bb3254-a50d-4f10-bd77-86c1367ae692"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:18.411379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3a4ac13d-33c1-450b-94d5-932d25567d06 req-fac89032-7eea-4ad3-8e66-e76817977cd8 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.411379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3a4ac13d-33c1-450b-94d5-932d25567d06 req-fac89032-7eea-4ad3-8e66-e76817977cd8 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.411379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3a4ac13d-33c1-450b-94d5-932d25567d06 req-fac89032-7eea-4ad3-8e66-e76817977cd8 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.427895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-3a4ac13d-33c1-450b-94d5-932d25567d06 req-fac89032-7eea-4ad3-8e66-e76817977cd8 service nova] Creating event network-changed:03bb3254-a50d-4f10-bd77-86c1367ae692 for instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 on hv-cinder-85426 Aug 24 03:36:18.434095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-3a4ac13d-33c1-450b-94d5-932d25567d06 req-fac89032-7eea-4ad3-8e66-e76817977cd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049578 Aug 24 03:36:18.434841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 196/397] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:18.443057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:18.444144 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:18.452961 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.453780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.454454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.455439 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.456215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.456881 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.640681 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.655942 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ebe9d02f-d856-4cef-ab37-39a1cec90137 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1509 microversion: 2.1 time: 0.534414 Aug 24 03:36:18.672256 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 202/398] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:18 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1509 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:18.720655 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.732537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f988cd1b-041c-4e01-9287-9dad7773a91c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.295643 Aug 24 03:36:18.736988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 197/399] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:18 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:18.823449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:18.824570 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:18.845401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.846250 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.847391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.848503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.850628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.854385 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.133225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.151649 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.156986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.159917 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-333cb76a-4efe-4b43-99c4-356e88b2938d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.343167 Aug 24 03:36:19.175891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 203/400] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:18 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:19.697393 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.698372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.710301 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.712898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.716069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.723467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.724187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.724932 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.758073 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.759548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.785431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.787468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.790552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.794282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.796654 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.797341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.200570 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.221434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d645fd4f-d6b2-4ca0-8239-207de6b5d73c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1509 microversion: 2.1 time: 0.538561 Aug 24 03:36:20.222619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 198/401] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1509 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:20.227749 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.228510 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:20.229300 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:20.237110 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.237695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-62dfbd80-f257-4275-83c9-752e75161329 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.483654 Aug 24 03:36:20.238048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.238302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 204/402] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:20.239047 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.240049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.240587 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.241234 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.436635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.453543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.455224 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.456445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-52f3d648-5bd9-4d1e-b068-3e570850e0be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.232216 Aug 24 03:36:20.457336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 199/403] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:20 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:21.259109 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:21.259721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:21.273642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:21.274291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:21.283487 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.283996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.284450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.288390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.294218 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.295085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.296576 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.297570 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.298358 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.307215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.308104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.308894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.961556 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:21.979359 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6e62a7fa-6a66-4cb2-8dff-e5895579873a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1509 microversion: 2.1 time: 0.724102 Aug 24 03:36:21.980956 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 205/404] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:21 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1509 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:21.992072 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:21.993797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:21.996756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.011366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0eed2141-02dd-46c4-bed1-b3702a9f6c01 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.742480 Aug 24 03:36:22.023827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 200/405] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:21 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:22.048278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.049179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.051580 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.053038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.058550 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.060486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.643114 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.684059 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.696198 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.699449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4c2049e6-dfd2-477c-a27e-7a4bcc64ab15 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.715289 Aug 24 03:36:22.702202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 206/406] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:21 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:23.024837 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:23.031364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:23.036752 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:23.037722 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:23.054816 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.055959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.056714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.062393 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.064107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.065208 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.065782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.066690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.067463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.067940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.068173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.068350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.715373 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:23.735267 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:23.764872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ce3550dc-537b-484e-aa9d-eaad5a751e8d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.731581 Aug 24 03:36:23.765954 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 207/407] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:23 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:23.779779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-65a0c5ed-d6ba-4c13-8f14-dab55b5fc3b4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1515 microversion: 2.1 time: 0.764868 Aug 24 03:36:23.804298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 201/408] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:23 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1515 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:23.859939 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:23.861217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:23.886930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.887739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.888508 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.889748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.890509 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.891257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.148140 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:24.152385 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.152882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.153322 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.227608 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.231603 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.234742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.287831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-2e3f61e8-4209-46b8-bfc7-124a9d9ca462 req-ad484cce-4f09-42bf-ae9e-99ab3e839fe8 admin admin] 10.222.0.79 "DELETE /compute/v2.1/os-assisted-volume-snapshots/6fe06d6b-9fd2-4539-b87c-64b670f0af56?delete_info=%7B%22file_to_merge%22:%20%22volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.6fe06d6b-9fd2-4539-b87c-64b670f0af56.vhdx%22,%20%22volume_id%22:%20%22df3d8848-3cb2-4415-889a-e65cc9f1f8fd%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.514534 Aug 24 03:36:24.292976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 208/409] 10.222.0.79 () {62 vars in 1800 bytes} [Wed Aug 24 03:36:23 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/6fe06d6b-9fd2-4539-b87c-64b670f0af56?delete_info=%7B%22file_to_merge%22:%20%22volume-df3d8848-3cb2-4415-889a-e65cc9f1f8fd.6fe06d6b-9fd2-4539-b87c-64b670f0af56.vhdx%22,%20%22volume_id%22:%20%22df3d8848-3cb2-4415-889a-e65cc9f1f8fd%22%7D => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:24.834263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:24.837390 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:24.840028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.853438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.857894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.862062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f7af5436-4d49-4901-b768-b8c54a64d792 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 1.054540 Aug 24 03:36:24.862766 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 202/410] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:23 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:24.887915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.899434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.901642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.903723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.905232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.906447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.612073 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:25.625962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a84a3b68-483f-4cca-bb26-527eff487bc0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.814038 Aug 24 03:36:25.628402 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 209/411] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:24 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:25.908127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:25.909770 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:25.912844 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:25.917964 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=6 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:25.926490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.926490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.926968 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.927693 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.928198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.928636 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.232708 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.258074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.263304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.266546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-672d1b49-dc7a-4a56-b330-de4fd2ec2599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.362515 Aug 24 03:36:26.268405 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 203/412] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:25 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:26.629373 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ba303c0f-aa3a-45a1-84a8-a0c123aa40ad tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'create', calling method: .version_select at 0x7f4f443fdc10>, body: {"keypair": {"name": "tempest-keypair-649500905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvHV/sioaJOnSgQx78b7N94gW29Ujh+1bDoaZJ8axiBVRAwQXn8VM7Ufh3mOleC1jgBAcJYI3k/ePMlN4fEVfyJUGAzwrYrfWzepcnPXcRDM8kDgQMjfpc9OzZz3t+/Zg=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:26.681382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-ba303c0f-aa3a-45a1-84a8-a0c123aa40ad tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for project 66a102abeb7f46a292a49d1f022190e7. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:26.692526 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-ba303c0f-aa3a-45a1-84a8-a0c123aa40ad tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for user ae4f7f8855b5445d863a825ce921c982 and project 66a102abeb7f46a292a49d1f022190e7. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:26.732877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:26.733897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:26.748071 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.751101 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.751655 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.752979 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.753651 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.754255 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.761977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ba303c0f-aa3a-45a1-84a8-a0c123aa40ad tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146604 Aug 24 03:36:26.769565 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 210/413] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:36:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:27.036887 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.063216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6a2e05f0-3239-456f-bb89-87cfb491960b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.336402 Aug 24 03:36:27.076623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 204/414] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:26 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:27.314177 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.315356 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:27.362049 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.362797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.385331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.386960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.387520 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.388554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.753124 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.782603 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.794775 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.802628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f7164181-a7a7-4aa9-bd16-8b8fbf1d0176 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.497032 Aug 24 03:36:27.805570 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 211/415] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:27 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:28.116097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:28.120312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:28.170445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.174826 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.178103 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:28.180883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.181751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.182256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:28.657308 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:28.670945 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-176b8017-139f-4b00-9107-e1d61e5b3168 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.563902 Aug 24 03:36:28.671949 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 205/416] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:28 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:28.833058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:28.834429 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:28.846032 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.848334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.849174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:28.850126 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.850804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.851519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.174566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.198223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.209805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.227312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-baaa507d-ed4f-461d-a688-a170fe2945da tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.401939 Aug 24 03:36:29.228264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 212/417] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:28 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:29.701349 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:29.708901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:29.738883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:29.739410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:29.740475 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.740637 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:29.740995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:29.741414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.037632 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.040715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:30.052084 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5d2a9dfd-5af8-4de5-a042-c628548759c1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.357740 Aug 24 03:36:30.053111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 206/418] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:29 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:30.256230 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:30.257313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:30.275252 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.275252 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.275252 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.278069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.278591 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.279053 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.282073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-672594034", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93612b14-fa84-4f16-a458-87833d8e8f3a"}], "security_groups": [{"name": "tempest-securitygroup--1657619551"}], "key_name": "tempest-keypair-649500905", "user_data": "}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:30.515931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.528738 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] validate_networks() for [('93612b14-fa84-4f16-a458-87833d8e8f3a', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:30.537472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.539529 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.540795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-49f43712-bd2b-43cf-85be-2519144f6b64 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1740 microversion: 2.20 time: 0.291036 Aug 24 03:36:30.546964 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 213/419] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:30 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:30.675132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:30.675649 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:30.701557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.702581 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.703232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.704181 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.704819 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.705247 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.971435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lazy-loading 'services' on Instance uuid 57df7f0f-a745-4701-ac63-b999f27fb3c4 {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:36:31.140345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d6afb15b-3c48-4109-b19d-3127cf804fd3 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4/os-volume_attachments/df3d8848-3cb2-4415-889a-e65cc9f1f8fd" status: 202 len: 0 microversion: 2.1 time: 0.469357 Aug 24 03:36:31.141044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 214/420] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:36:30 2022] DELETE /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4/os-volume_attachments/df3d8848-3cb2-4415-889a-e65cc9f1f8fd => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:36:31.149360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.149957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:31.170985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.171514 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.172359 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.176271 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.176795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.177300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.741348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:31.742818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:31.743523 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:31.744139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:31.744770 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:31.764108 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.764889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.765536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.767381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.768250 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.769012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.829458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for project 66a102abeb7f46a292a49d1f022190e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:31.835040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Getting quotas for user ae4f7f8855b5445d863a825ce921c982 and project 66a102abeb7f46a292a49d1f022190e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:31.839772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.853314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:31.856495 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:31.859841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8dbb7e11-05a1-4294-8be6-049dcb0f2171 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.716700 Aug 24 03:36:31.861483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 215/421] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:31.871059 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.872469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:31.890458 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.895392 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.896506 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.898202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.899451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.900575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.959035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:31.964735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-29439eab-05d4-4f0c-ae85-cc86bdce9121 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.687571 Aug 24 03:36:31.966524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 207/422] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:36:31.991967 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f0104aaf-654a-4a6f-8352-2613237a0f5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.996455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f0104aaf-654a-4a6f-8352-2613237a0f5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:32.188967 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f0104aaf-654a-4a6f-8352-2613237a0f5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:32.221080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f0104aaf-654a-4a6f-8352-2613237a0f5c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1244 microversion: 2.1 time: 0.238505 Aug 24 03:36:32.222287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 208/423] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1244 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:32.297556 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:32.331999 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:32.339991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:32.342796 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1f91df62-1b5d-4d15-934c-6cd73e7309ad tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1722 microversion: 2.20 time: 0.479153 Aug 24 03:36:32.352160 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 216/424] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:32.889257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:32.895247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:32.934095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.936052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.940367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.942819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.943690 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.944488 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.262418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.267095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:33.322627 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.324297 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.324761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.326968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.327752 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.328340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.336272 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.339647 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e0f92790-95e9-419a-b524-6d15ec053cf3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.458874 Aug 24 03:36:33.343136 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 209/425] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:32 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:33.382176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.383391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:33.399443 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.400902 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.402402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.404686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.406117 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.407356 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.624447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.642443 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0e620fb7-0eba-4cec-a5f0-66b889c2c2d7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1240 microversion: 2.1 time: 0.389660 Aug 24 03:36:33.661063 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 217/426] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:33 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1240 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:33.721848 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.722540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:33.733334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.734218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.734914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.735889 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.736609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.737259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.776593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:36:33.911595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.928916 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.931005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.932500 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-452df8b5-6d5b-4933-beb0-eb5553a1beb3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1722 microversion: 2.20 time: 0.559340 Aug 24 03:36:33.933835 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 210/427] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:33 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1722 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:34.008071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-344a5c77-a09b-4b42-8fa3-07a725ce4b9c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 204 len: 0 microversion: 2.1 time: 0.290226 Aug 24 03:36:34.016312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 218/428] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:36:33 2022] DELETE /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:36:34.025775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.027191 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.041511 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.042756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.043841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.046411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.047714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.048753 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.293291 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-eebee0c6-f528-462d-beb8-db1991e9ce93 req-6a88c6d3-4502-44e6-a514-6240791d1726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ca164a-c24d-4225-89e6-d5718d7e88b4", "name": "network-vif-plugged", "status": "completed", "tag": "03bb3254-a50d-4f10-bd77-86c1367ae692"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:34.318986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:34.347992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-eebee0c6-f528-462d-beb8-db1991e9ce93 req-6a88c6d3-4502-44e6-a514-6240791d1726 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.349505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-eebee0c6-f528-462d-beb8-db1991e9ce93 req-6a88c6d3-4502-44e6-a514-6240791d1726 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.350687 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-eebee0c6-f528-462d-beb8-db1991e9ce93 req-6a88c6d3-4502-44e6-a514-6240791d1726 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.406909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-eebee0c6-f528-462d-beb8-db1991e9ce93 req-6a88c6d3-4502-44e6-a514-6240791d1726 service nova] Creating event network-vif-plugged:03bb3254-a50d-4f10-bd77-86c1367ae692 for instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 on hv-cinder-85426 Aug 24 03:36:34.411521 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.425927 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-eebee0c6-f528-462d-beb8-db1991e9ce93 req-6a88c6d3-4502-44e6-a514-6240791d1726 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139957 Aug 24 03:36:34.430555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 219/429] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:34.439844 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7ec0a42b-eeca-4627-817d-e9a3a5c9bb89 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1513 microversion: 2.1 time: 0.422087 Aug 24 03:36:34.453400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.455474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.469938 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 211/430] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1513 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:34.487154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.487659 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.488107 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.488845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.489304 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.489732 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.676133 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.676908 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.687025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.687958 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.688666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.689645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.690337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.691030 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.784646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.794406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-67f738a9-6107-4e78-b62a-769602145405 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1296 microversion: 2.1 time: 0.131581 Aug 24 03:36:34.807815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 212/431] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1296 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:34.815111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.823526 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-75e65b07-3424-406c-beba-d408979ef1a7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.390999 Aug 24 03:36:34.824481 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 220/432] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:34.971997 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.973433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.980968 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.981787 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.982475 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.983900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.984605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.985217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.267307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:35.280173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:35.282042 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:35.283335 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d547797a-e6c8-4595-8f8e-717332e7ec33 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1722 microversion: 2.20 time: 0.315828 Aug 24 03:36:35.284320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 213/433] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:35.477025 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.477691 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:35.493149 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.494007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.494785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.496085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.497083 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.498156 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.788710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:35.804442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f70cbe52-ff82-4687-a677-0a547b7a76fa tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1513 microversion: 2.1 time: 0.330143 Aug 24 03:36:35.819467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 221/434] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1513 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:35.824084 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.825154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:35.848303 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.849373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.850037 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.851260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.852066 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.852711 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.890007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.894849 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:35.909539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.911260 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.911923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.912931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.913815 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.914478 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.058742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.081944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-567c26b4-dd9e-4209-b906-baa3530eb151 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1296 microversion: 2.1 time: 0.266689 Aug 24 03:36:36.088812 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 214/435] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1296 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:36.198002 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.212787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e47d519e-bc7a-4dce-8d02-6eb7ecf6bb98 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.342171 Aug 24 03:36:36.214137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 222/436] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:36.331296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:36.332803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:36.351553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.352865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.353898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.355519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.356361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.359806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.471521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-199aba72-329a-4ae2-9f0b-8005cb52fc02 req-5f421cd5-193f-403d-9289-6a1717c9f94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaca649f-ad0a-4355-b741-7e46388c74cd", "name": "network-vif-unplugged", "status": "completed", "tag": "f8a2d888-1c8d-4395-a171-9a83d1745a85"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:36.497668 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-199aba72-329a-4ae2-9f0b-8005cb52fc02 req-5f421cd5-193f-403d-9289-6a1717c9f94c service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.498758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-199aba72-329a-4ae2-9f0b-8005cb52fc02 req-5f421cd5-193f-403d-9289-6a1717c9f94c service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.498903 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-199aba72-329a-4ae2-9f0b-8005cb52fc02 req-5f421cd5-193f-403d-9289-6a1717c9f94c service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.531948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-199aba72-329a-4ae2-9f0b-8005cb52fc02 req-5f421cd5-193f-403d-9289-6a1717c9f94c service nova] Creating event network-vif-unplugged:f8a2d888-1c8d-4395-a171-9a83d1745a85 for instance aaca649f-ad0a-4355-b741-7e46388c74cd on hv-cinder-85426 Aug 24 03:36:36.540072 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-199aba72-329a-4ae2-9f0b-8005cb52fc02 req-5f421cd5-193f-403d-9289-6a1717c9f94c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072528 Aug 24 03:36:36.540989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 223/437] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:36.665827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.677974 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.683361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.684684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0c7e9ef1-c8ae-41db-9434-5ff38f12265e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1722 microversion: 2.20 time: 0.364149 Aug 24 03:36:36.710072 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 215/438] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:36 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:36.851750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:36.854406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:36.860278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=4 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:36.873387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.874265 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.884575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.885797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.887123 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.887946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.121007 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:37.123276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:37.137524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.138951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.140797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.143672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.144924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.145934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.218150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.239030 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8e239fe1-323e-4233-a9c1-d9d28d77db91 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1513 microversion: 2.1 time: 0.396363 Aug 24 03:36:37.243294 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 224/439] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:36 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:37.255660 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:37.257612 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:37.279912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.281292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.282957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.285173 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.286353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.288565 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.320502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.341468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ae6d7134-1a95-47c5-918e-7c940bbf6034 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1296 microversion: 2.1 time: 0.228117 Aug 24 03:36:37.344284 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 216/440] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:37 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1296 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:37.565707 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.579265 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ca83fa54-7ebf-43e2-85f9-c688127be8eb tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.333726 Aug 24 03:36:37.581838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 225/441] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:37 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:37.718168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:37.719755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:37.735075 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.736359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.737732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.741420 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.743069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.744334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.034285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.050384 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.053750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.057809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fd018053-7316-4187-8558-b30678e64d69 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1722 microversion: 2.20 time: 0.349362 Aug 24 03:36:38.082870 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 217/442] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:37 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:38.285039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:38.287252 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:38.297080 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.297577 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.298004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.299030 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.299719 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.300411 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.380774 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:38.383526 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:38.397896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.399118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.400445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.401634 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.402385 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.403321 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.471096 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.481188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f8bf69ec-9236-4ef9-a0fa-fdf9347b4982 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1513 microversion: 2.1 time: 0.200948 Aug 24 03:36:38.483401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 226/443] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:38 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:38.511811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.526358 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fe9e23a4-b06b-450f-8314-966f08c3ec8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1296 microversion: 2.1 time: 0.155205 Aug 24 03:36:38.527858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 218/444] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:38 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1296 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:38.627921 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:38.629768 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:38.641120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.641834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.650834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.652328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.654526 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.655520 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.878218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.888793 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2dce40fb-9042-439d-a39a-c466bedbb136 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.272225 Aug 24 03:36:38.889758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 227/445] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:38 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:39.106260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:39.108459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:39.124326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.125456 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.126473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.127966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.128949 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.130146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.337094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.349078 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.351646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.353131 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-047c4f41-06c4-41e4-8a8d-38917898f822 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1722 microversion: 2.20 time: 0.259243 Aug 24 03:36:39.368382 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 219/446] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:39 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:39.511204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:39.513866 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:39.527443 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.530197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.531909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.533612 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.534836 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.535918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.565540 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:39.568185 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:39.603711 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.604751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.629002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.630701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.632562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.634305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.815678 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.833182 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fd222dd5-b0a4-48c1-bcd1-e450b3446b60 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1296 microversion: 2.1 time: 0.288058 Aug 24 03:36:39.837000 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 220/447] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:39 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1296 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:39.929699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:39.930880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:39.949274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.950024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.951763 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.954296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.955960 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.956533 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.964485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.981331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-93beddca-199e-4e44-abe0-470f1585239b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1513 microversion: 2.1 time: 0.476822 Aug 24 03:36:39.982933 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 228/448] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:39 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1513 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:40.169440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:40.179670 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a2960548-0316-41d6-8f5d-d1ed7284e708 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.257721 Aug 24 03:36:40.182958 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 221/449] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:39 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:40.383946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:40.385036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:40.396514 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.397330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.398310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:40.400085 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.400901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.401948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:40.676913 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:40.691652 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:40.693435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:40.694894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-649e09e8-03bc-4dda-804d-20d6455ba9a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1722 microversion: 2.20 time: 0.318530 Aug 24 03:36:40.695842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 229/450] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:40 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:40.867179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:40.868370 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:40.882170 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.882702 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.883139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:40.883892 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.884366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.884794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.008572 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:41.010300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:41.032569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.037205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.040215 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.042959 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.047289 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.049635 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.123776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.140779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-993cf3d3-0f27-46af-9c05-de94fcdcd19b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1296 microversion: 2.1 time: 0.273633 Aug 24 03:36:41.161599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 222/451] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:40 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1296 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:41.205294 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:41.206313 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:41.220675 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.222254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.223863 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.225906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.227364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.228480 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.575813 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.587612 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-74988785-d8f6-4065-858e-1dc2a452d094 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1513 microversion: 2.1 time: 0.585373 Aug 24 03:36:41.588572 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 230/452] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:41 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1513 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:41.629318 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.660051 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d7eee20f-c0cb-4e66-aee1-75ca6e48f112 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.461514 Aug 24 03:36:41.661651 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 223/453] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:41 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:41.735706 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:41.736341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:41.755981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.757029 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.761230 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.762370 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.767634 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.768095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.167507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:42.168467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:42.182996 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:42.188214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.188750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.189216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.190053 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.190550 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.191034 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.216297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=8 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:42.254324 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.285262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.296357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.303336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a7e951ed-d88a-4b68-a434-dceaae586757 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1725 microversion: 2.20 time: 0.569311 Aug 24 03:36:42.311468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 231/454] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:41 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1725 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:42.346070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f95c34e2-4354-4011-8927-d1411d8f4859"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:42.353239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:42.367680 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.368738 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.370382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.371864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.372871 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.373735 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.429078 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.453541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7759b26a-3582-4bde-810f-93c3002feb0c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1302 microversion: 2.1 time: 0.289809 Aug 24 03:36:42.467227 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 224/455] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:42 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1302 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:42.511469 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:42.645847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:42.658097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:42.681690 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.682475 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.695852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.696797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.698332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.699187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.704665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:43.136403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.158949 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-37036c4c-ca51-496e-9649-c7a71d10a13d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1513 microversion: 2.1 time: 0.520839 Aug 24 03:36:43.177088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 225/456] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:42 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1513 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:43.193207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:43.210127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:43.235280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.236491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.237618 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.239068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.240174 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.241073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.327947 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2e228b1c-19e9-40ad-a1c9-4b45ad5c892a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.990394 Aug 24 03:36:43.329678 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 232/457] 10.222.0.78 () {62 vars in 1364 bytes} [Wed Aug 24 03:36:42 2022] POST /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments => generated 188 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:36:43.488975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:43.490186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:43.495363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:43.508332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.509488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.510471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.512050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.514500 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.515824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.682068 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.701711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-db8b598e-f2dc-442f-b4d5-93b4c4d096d6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1302 microversion: 2.1 time: 0.226787 Aug 24 03:36:43.713158 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 233/458] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:43 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1302 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:43.729097 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:43.733860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:43.757419 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.758409 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.759157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.760275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.761112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.761818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.895142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.922068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e3e5d869-7144-4dbc-9a4f-0efc5a0e4bf0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1366 microversion: 2.1 time: 0.743121 Aug 24 03:36:43.940112 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 226/459] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:43 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1366 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:43.953610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127257) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:36:44.204110 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cb662638-5034-474d-b924-31e96875b386 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/action" status: 202 len: 0 microversion: 2.20 time: 0.488727 Aug 24 03:36:44.205749 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 234/460] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 24 03:36:43 2022] POST /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:44.213396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:44.221645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:44.238480 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:44.241282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:44.267662 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.275459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.278625 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.281098 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.285019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.286104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.290257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.291095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.292211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.295714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.298222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.301517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.843590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:44.903684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e159afa9-ef02-4995-9657-ba6d2075ffd5 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 200 len: 1303 microversion: 2.1 time: 0.690685 Aug 24 03:36:44.911467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 227/461] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:44 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 1303 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:44.985619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-dfc228dd-529c-45e8-bdc0-b3004ec6f19f req-f1ed2e58-dffc-49a8-b3fb-b689a5f9bed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57df7f0f-a745-4701-ac63-b999f27fb3c4", "name": "network-vif-deleted", "tag": "08dfef01-c1f9-43ee-8a63-4b93325cac06"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:45.033743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-dfc228dd-529c-45e8-bdc0-b3004ec6f19f req-f1ed2e58-dffc-49a8-b3fb-b689a5f9bed2 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.037341 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-dfc228dd-529c-45e8-bdc0-b3004ec6f19f req-f1ed2e58-dffc-49a8-b3fb-b689a5f9bed2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.040769 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-dfc228dd-529c-45e8-bdc0-b3004ec6f19f req-f1ed2e58-dffc-49a8-b3fb-b689a5f9bed2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.080472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-dfc228dd-529c-45e8-bdc0-b3004ec6f19f req-f1ed2e58-dffc-49a8-b3fb-b689a5f9bed2 service nova] Creating event network-vif-deleted:08dfef01-c1f9-43ee-8a63-4b93325cac06 for instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 on hv-cinder-85426 Aug 24 03:36:45.123297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-dfc228dd-529c-45e8-bdc0-b3004ec6f19f req-f1ed2e58-dffc-49a8-b3fb-b689a5f9bed2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209239 Aug 24 03:36:45.128918 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 228/462] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:45.133216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.141981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:45.146786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:45.156714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.157616 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.158365 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.164142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.167022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.171744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.172676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.174289 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.187840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-74260951-158f-4c5f-822b-ae936f58d540 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1751 microversion: 2.20 time: 0.974346 Aug 24 03:36:45.188761 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 235/463] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:44 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1751 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:45.216157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:45.219457 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:45.238224 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.239472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.241369 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.244066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.248912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.249778 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.873030 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.888218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9d62d65e-c939-4fc0-9095-7fbcae4e7108 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1556 microversion: 2.1 time: 0.697909 Aug 24 03:36:45.890595 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 236/464] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:45 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1556 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:45.915882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:45.920908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:45.929169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.945380 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-dc96ad2f-7166-4035-8259-208802a9282b tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.814838 Aug 24 03:36:45.947945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.959922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 229/465] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:45 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:45.966573 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.969310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.976183 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.976888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.978789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.980389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:45.983716 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 57df7f0f-a745-4701-ac63-b999f27fb3c4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:45.994513 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.995460 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.996140 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.001200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.003675 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.007403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.078049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] HTTP exception thrown: Instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 could not be found. Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Request method failure captured: Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 HTTP/1.1 Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZxT3lJp43eMrA4HAMrqrCT8bkYBJNbDrHtyTzRGoScnpvEwn9V-hHCBuX1ZmYC85VDk11sFvDz_JiSBmmqoR4H7DkgpHsPZMu_Un0slPxZzPUbENnBhKqzqi6qIgiLNDPjw2cq_gPFoFbu68DrC-gCAw5OV7-ZfA6ssSSpEYzzkx3k Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 727bfec133af4b0db4dd397ee32fbb2e Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-VolumesSnapshotTestJSON-118155070 Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:36:46.101682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/727bfec133af4b0db4dd397ee32fbb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/727bfec133af4b0db4dd397ee32fbb2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/727bfec133af4b0db4dd397ee32fbb2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_727bfec133af4b0db4dd397ee32fbb2e"}]}] Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-VolumesSnapshotTestJSON-118155070 Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 727bfec133af4b0db4dd397ee32fbb2e Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-118155070 Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-VolumesSnapshotTestJSON-118155070-project Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: b985a376cdbd45bf80a3142ffbd81fba Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-VolumesSnapshotTestJSON-118155070-project Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 could not be found. Aug 24 03:36:46.103656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '57df7f0f-a745-4701-ac63-b999f27fb3c4'} Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 could not be found. Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:46.104562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 could not be found. Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 could not be found. Aug 24 03:36:46.105785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:36:46.109076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Returning 404 to user: Instance 57df7f0f-a745-4701-ac63-b999f27fb3c4 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:46.109076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-275626f0-78b5-4dda-aed1-1ee2aeecce86 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4" status: 404 len: 111 microversion: 2.1 time: 0.143028 Aug 24 03:36:46.122726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 230/466] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:45 2022] GET /compute/v2.1/servers/57df7f0f-a745-4701-ac63-b999f27fb3c4 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:46.150117 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2dc2b8d5-0408-449d-a92f-d3b6acc4fcd6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.240438 Aug 24 03:36:46.151930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 237/467] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:36:45 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:46.228977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:46.239116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:46.253600 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.254493 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.255316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.256612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.263544 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.264488 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.711984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.762111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.779305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.787002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8e833a52-494e-4c62-9083-b610d46baa45 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1751 microversion: 2.20 time: 0.569276 Aug 24 03:36:46.791432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 231/468] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:46 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1751 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:46.976697 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:46.977912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:47.025185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.026070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.026932 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.028262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.029132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.030106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.474763 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.502216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c5d942b8-0a44-4cf2-89e8-b6b06c4c06b9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.531198 Aug 24 03:36:47.506409 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 238/469] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:46 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:47.601087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-e2614069-9f66-4654-9f32-ac2ea96e3942 req-eea34c73-06fe-492a-baba-40a7270bb91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f097f4-3522-408a-b729-f895148b7fbb", "tag": "c6ee4054-246d-400d-a193-9ca2efe2b6d1"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:47.629183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e2614069-9f66-4654-9f32-ac2ea96e3942 req-eea34c73-06fe-492a-baba-40a7270bb91d service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.630477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e2614069-9f66-4654-9f32-ac2ea96e3942 req-eea34c73-06fe-492a-baba-40a7270bb91d service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.636714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e2614069-9f66-4654-9f32-ac2ea96e3942 req-eea34c73-06fe-492a-baba-40a7270bb91d service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.669141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-e2614069-9f66-4654-9f32-ac2ea96e3942 req-eea34c73-06fe-492a-baba-40a7270bb91d service nova] Creating event network-changed:c6ee4054-246d-400d-a193-9ca2efe2b6d1 for instance 89f097f4-3522-408a-b729-f895148b7fbb on hv-cinder-85426 Aug 24 03:36:47.682374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-e2614069-9f66-4654-9f32-ac2ea96e3942 req-eea34c73-06fe-492a-baba-40a7270bb91d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090602 Aug 24 03:36:47.685999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 232/470] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:47.852292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:47.855660 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:47.889619 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.890958 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.892738 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.898069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.899592 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.900965 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.546009 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:48.547212 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:48.578503 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.579591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.617119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.619984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.628343 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.629753 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.648220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.674631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.698045 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.705035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-efad8bda-4f37-4d2f-ba9a-9a6cf0f077bf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1751 microversion: 2.20 time: 0.881111 Aug 24 03:36:48.706380 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 239/471] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:47 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1751 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:49.254865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:49.267084 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cbdcd5ca-c4fe-4e97-8589-c8ad3d6516af tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.730368 Aug 24 03:36:49.295934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 233/472] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:48 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:49.581953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-8abab459-ff3d-427f-bd5d-d73ee27762ca req-3c80036c-2e03-4aa1-a285-35b64a038624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ca164a-c24d-4225-89e6-d5718d7e88b4", "tag": "03bb3254-a50d-4f10-bd77-86c1367ae692"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:49.595328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-8abab459-ff3d-427f-bd5d-d73ee27762ca req-3c80036c-2e03-4aa1-a285-35b64a038624 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.596256 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-8abab459-ff3d-427f-bd5d-d73ee27762ca req-3c80036c-2e03-4aa1-a285-35b64a038624 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.597370 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-8abab459-ff3d-427f-bd5d-d73ee27762ca req-3c80036c-2e03-4aa1-a285-35b64a038624 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.618611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-8abab459-ff3d-427f-bd5d-d73ee27762ca req-3c80036c-2e03-4aa1-a285-35b64a038624 service nova] Creating event network-changed:03bb3254-a50d-4f10-bd77-86c1367ae692 for instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 on hv-cinder-85426 Aug 24 03:36:49.642251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-8abab459-ff3d-427f-bd5d-d73ee27762ca req-3c80036c-2e03-4aa1-a285-35b64a038624 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065777 Aug 24 03:36:49.656671 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 240/473] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:49.793374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:49.795917 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:49.807976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.808830 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.809438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.811169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.811823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.812437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.130190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.145237 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.147683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.149383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ae4b5d56-e192-46d9-b904-1efab933514d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1753 microversion: 2.20 time: 0.395994 Aug 24 03:36:50.149891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 234/474] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:49 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1753 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:50.306145 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:50.306801 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:50.318829 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:50.319741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:50.321364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.323055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:50.323540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:50.325021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.509894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.520736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-93f7db63-05f6-4e7f-8cf5-fde023aec4bb tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.220950 Aug 24 03:36:50.535235 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 241/475] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:50 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:51.176104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:51.177491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:51.187406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.188216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.188850 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.189765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.190389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.191007 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.306608 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1946039822", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "networks": [{"uuid": "9ed880dc-9032-4bf8-b7c3-b645c6c79824"}]}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:51.404581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.418840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.421427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.422973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-edf4ca5b-883a-42f8-9430-f5d3699aae25 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1753 microversion: 2.20 time: 0.250930 Aug 24 03:36:51.423558 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 235/476] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:51 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:51.456364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] validate_networks() for [('9ed880dc-9032-4bf8-b7c3-b645c6c79824', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:51.545614 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:51.546257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:51.565282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.566175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.566964 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.568090 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.568619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.569087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.425194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.440011 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-58bf8793-bb1d-4fa6-9783-bc4b90459606 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.899043 Aug 24 03:36:52.441862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 236/477] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:51 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:52.453427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:52.455018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:52.470363 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.471730 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.472591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.474085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.475046 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.476391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.795134 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:52.795920 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:52.796425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:52.796986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:52.800650 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:52.821425 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.852374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.857700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.861138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.862253 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.863143 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.864571 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.866702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.868172 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d55816a6-8d59-4cbb-aa3c-b14be78615c5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.423579 Aug 24 03:36:52.869139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.872713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 237/478] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:52 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:52.914283 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Getting quotas for project 727bfec133af4b0db4dd397ee32fbb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:52.923548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Getting quotas for user b985a376cdbd45bf80a3142ffbd81fba and project 727bfec133af4b0db4dd397ee32fbb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:52.947629 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:52.953476 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:53.055876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fb5f3546-311d-4bc9-9d43-7d5c3c38a49d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757508 Aug 24 03:36:53.067844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 242/479] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:36:53.081031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-129ed930-9fae-4675-877a-b35ba671ee36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:53.083036 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-129ed930-9fae-4675-877a-b35ba671ee36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:53.277434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-129ed930-9fae-4675-877a-b35ba671ee36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.291187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-129ed930-9fae-4675-877a-b35ba671ee36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1219 microversion: 2.1 time: 0.220419 Aug 24 03:36:53.292182 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 238/480] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:53 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1219 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:53.468204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:53.469033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:53.500943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.501796 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.502696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.515905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.516801 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.517569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.918296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:53.930769 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:53.952012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.953291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.954295 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.955904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.958452 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.963902 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.981020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.997000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6f98a26c-4187-494e-8ecf-9df09c250070 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.536835 Aug 24 03:36:54.015966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 243/481] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:53 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:54.326202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.333741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d08b4b87-4c2c-480a-b255-3b9a281f8a10 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:54.334868 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d08b4b87-4c2c-480a-b255-3b9a281f8a10 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:54.347304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.349282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.350829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-43ae86e3-0fda-456f-a8ca-5ed5c2161f73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.441244 Aug 24 03:36:54.353459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 239/482] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:53 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:54.511027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d08b4b87-4c2c-480a-b255-3b9a281f8a10 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.525809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d08b4b87-4c2c-480a-b255-3b9a281f8a10 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1219 microversion: 2.1 time: 0.199067 Aug 24 03:36:54.527075 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 244/483] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:54 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1219 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:55.056395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:55.060599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:55.075657 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.078092 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.079867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.081664 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.082984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.084233 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.350299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.366083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a80cb828-3ca3-454a-835e-6c923858c08e tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.323404 Aug 24 03:36:55.367462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 240/484] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:55 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:55.400003 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:55.402434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:55.413741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.414632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.415717 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.417246 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.418151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.419078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.560353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:55.561217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:55.568472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.569255 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.569803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.570870 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.571446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.571981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.713841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.727691 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.733432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.739864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.743102 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0fae6af4-2f7b-4691-a4da-ae052cc59480 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.350625 Aug 24 03:36:55.743723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 245/485] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:55 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:55.754167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a983fb63-d873-4bd8-8c54-9e7a62b56851 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1271 microversion: 2.1 time: 0.198680 Aug 24 03:36:55.755067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 241/486] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:55 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:56.061960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-a01ff6ac-8d5e-44e0-81eb-85aef91b3fce req-d352b8fa-aaf6-4fff-a215-25be7faec912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f097f4-3522-408a-b729-f895148b7fbb", "name": "network-vif-plugged", "status": "completed", "tag": "c6ee4054-246d-400d-a193-9ca2efe2b6d1"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:56.091188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a01ff6ac-8d5e-44e0-81eb-85aef91b3fce req-d352b8fa-aaf6-4fff-a215-25be7faec912 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.091864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a01ff6ac-8d5e-44e0-81eb-85aef91b3fce req-d352b8fa-aaf6-4fff-a215-25be7faec912 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.092313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a01ff6ac-8d5e-44e0-81eb-85aef91b3fce req-d352b8fa-aaf6-4fff-a215-25be7faec912 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.129407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-a01ff6ac-8d5e-44e0-81eb-85aef91b3fce req-d352b8fa-aaf6-4fff-a215-25be7faec912 service nova] Creating event network-vif-plugged:c6ee4054-246d-400d-a193-9ca2efe2b6d1 for instance 89f097f4-3522-408a-b729-f895148b7fbb on hv-cinder-85426 Aug 24 03:36:56.140668 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-a01ff6ac-8d5e-44e0-81eb-85aef91b3fce req-d352b8fa-aaf6-4fff-a215-25be7faec912 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083240 Aug 24 03:36:56.145974 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 246/487] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:56.402104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.402714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.407143 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:56.458198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.462465 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.464794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.470964 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.473170 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.474406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.787989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.793305 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.813782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.821314 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.822220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.823913 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.825856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.828227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.947765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.978229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cdc46c15-6074-4b7b-8f03-df91ae05fc53 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.574806 Aug 24 03:36:56.979940 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 242/488] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:57.004773 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:57.014686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:57.046351 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.050274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.051334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.055341 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.059215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.061153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.351706 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.379630 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.383209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.384880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5b3807ab-026a-460c-b181-ea45ce6bb015 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.618891 Aug 24 03:36:57.395485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 247/489] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:57.447179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.460434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-aa197325-4f15-4df6-a2be-9f93dea27b9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.475934 Aug 24 03:36:57.462304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 243/490] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:58.029738 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.031464 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.058330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.058783 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.059285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.060985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.061472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.061906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.374483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.386704 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c406ebb0-5a77-4797-aef5-97e58f7f9cb0 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.367898 Aug 24 03:36:58.394233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 248/491] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:58.411419 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.412038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.420580 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.421088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.421532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.422326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.422900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.423341 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.492333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.493004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.548144 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.555538 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.556711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.558153 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.561535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.562770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.580872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:58.859856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.864467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:58.873674 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.875512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.877018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bbaf0d8f-ac25-4619-9dc8-a6c753b48a21 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.469867 Aug 24 03:36:58.893517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 244/492] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:59.026824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.047270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5d97fbb1-9853-4717-b950-61b8f54558b2 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.558395 Aug 24 03:36:59.050036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 249/493] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:59.423017 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:59.423966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:59.444260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.445347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.446352 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.449882 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.451124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.452262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.733396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.743074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2d8dfc79-7c53-4d6e-ab76-73f06cb15c39 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.333922 Aug 24 03:36:59.743686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 245/494] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:59 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:59.830045 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4e922598-f2a1-48c2-9d59-ea0b820636d4 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Action: 'create', calling method: .version_select at 0x7f4f4428c430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1329602727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcbfdssT9kK6soqlsLzzf2jhgNZD6uPr5YWFcvu9X7aroxjcDd0JcM29zLQXOzEI5Q9BV/lmXskUtVeE69MEezBueno/DkYFOiKW/DfyOQnsBHL6fING/lMtRJ/Jw/v1A=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:59.859179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-4e922598-f2a1-48c2-9d59-ea0b820636d4 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Getting quotas for project f0af57c134de4e0a888e90e50510d915. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:59.864302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-4e922598-f2a1-48c2-9d59-ea0b820636d4 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Getting quotas for user b829d1bdf9764cefa06ca6f9c5f69296 and project f0af57c134de4e0a888e90e50510d915. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:59.893548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4e922598-f2a1-48c2-9d59-ea0b820636d4 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.067395 Aug 24 03:36:59.894160 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 250/495] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:36:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:59.919591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:59.920908 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:59.931562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.932359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.933113 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.934347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.936241 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.936983 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.951282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-754527613", "imageRef": "a6def216-73f5-4f6f-86ab-8448f58968e0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1329602727", "networks": [{"uuid": "60953432-4c74-45e4-87c3-62f819f36c7d"}]}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:00.026615 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] validate_networks() for [('60953432-4c74-45e4-87c3-62f819f36c7d', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:37:00.266847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.277103 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.279613 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.280767 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c1141912-b830-47dd-b68f-e65e795016ff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.368894 Aug 24 03:37:00.281376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 246/496] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:59 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:00.286723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:00.287410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:00.295348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.295858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.296301 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.297038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.297502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.298086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.539052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.550135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f2ff5961-debd-47a8-85ab-cd71844dbe69 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.267283 Aug 24 03:37:00.551539 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 247/497] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:00 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:00.680178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:37:00.680669 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:37:00.681064 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:37:00.681466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:37:00.681875 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:37:00.692739 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.693258 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.693713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.694465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.694948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.695377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.714151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Getting quotas for project f0af57c134de4e0a888e90e50510d915. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:37:00.719060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Getting quotas for user b829d1bdf9764cefa06ca6f9c5f69296 and project f0af57c134de4e0a888e90e50510d915. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:37:00.731775 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:37:00.733985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6def216-73f5-4f6f-86ab-8448f58968e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:37:00.777843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:00.779537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:00.787990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.788863 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.789573 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.790499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.791215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.791861 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.834067 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8372cef3-f68d-434d-8071-69bde5026c2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886212 Aug 24 03:37:00.847911 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 251/498] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:37:00.857908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f394bdba-5287-4fa0-8fb0-15e11e9156ed tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:00.859414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f394bdba-5287-4fa0-8fb0-15e11e9156ed tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:00.983035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f394bdba-5287-4fa0-8fb0-15e11e9156ed tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.007240 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f394bdba-5287-4fa0-8fb0-15e11e9156ed tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1258 microversion: 2.1 time: 0.155670 Aug 24 03:37:01.026778 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 252/499] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:00 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:01.052470 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.068985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f4199e71-bf8c-47ab-928c-3e05b578ae89 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.295964 Aug 24 03:37:01.087276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 248/500] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:00 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:01.312769 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:01.313426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:01.321060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.321567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.322080 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.323003 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.323605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.324100 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.585735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:01.595116 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.596281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:01.616972 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.620951 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.622195 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.623474 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.623901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5b0a0089-57fc-4886-a319-c4c54c938ddc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.315627 Aug 24 03:37:01.624775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.626765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 253/501] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:01 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:01.628550 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.629767 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.630529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.878827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.900969 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-db227543-9632-481c-b2b4-8fdceee3991b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.323631 Aug 24 03:37:01.902263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 249/502] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:01 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:02.046892 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.047587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.055628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.056260 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.056800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.057615 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.058295 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.059087 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.105142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.106220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.117425 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.118226 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.119052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.120303 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.121112 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.121874 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.164184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.177852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-132a5af8-df61-413a-a14c-e7d5d1d662ba tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.135796 Aug 24 03:37:02.179340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 254/503] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:02.374086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.384246 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1402ed06-d060-4f77-b7fc-10d7b8ee7643 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.286129 Aug 24 03:37:02.386097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 250/504] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:02.658512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.659069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.665677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.666173 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.666607 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.667355 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.667806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.668242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.933318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.938217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.939628 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.948511 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.949437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.950258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.951823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.952988 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.953654 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.954686 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.958441 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.960901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1e191d23-bda5-4bcb-94dc-ac9b443b69b8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.306696 Aug 24 03:37:02.978695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 255/505] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:03.158673 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.166989 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9e05cae5-c7a7-48c8-9dac-d7aeaf482162 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.235366 Aug 24 03:37:03.167593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 251/506] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:03.224927 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.227495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.241665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.243170 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.244312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.245965 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.247931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.249141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.352913 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.361995 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-55865862-0531-4311-b930-0e9e4cf18dda tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.147432 Aug 24 03:37:03.362599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 256/507] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:03.421095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.421830 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.424047 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:03.430724 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.431332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.431824 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.432651 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.433184 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.433745 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.658479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.680298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-742296c6-02b4-45a9-b7b6-ef62b2d77d71 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.263027 Aug 24 03:37:03.704249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 252/508] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:04.001018 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.001636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.008477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.008950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.009416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.010136 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.010575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.011042 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.196473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.198673 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.212114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.212906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.213709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.215161 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.217058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.217887 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.234605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.244657 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.246205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.247766 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fb39e110-9c82-437e-8f00-4df7297b470c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.251762 Aug 24 03:37:04.248350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 257/509] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:04.397645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.399655 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.411727 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:04.412776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.417914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.421200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.423385 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-da4f3704-b0cd-45c4-9c00-e5565488d1d1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.236478 Aug 24 03:37:04.423896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.427346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 253/510] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:04 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:04.428674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.429366 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.430022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.546880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.574066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-eec7f993-8f4b-4701-8ee3-c2488878c59d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.183463 Aug 24 03:37:04.575901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 258/511] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:04 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:04.722155 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.723076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.733886 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.734861 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.735692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.737178 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.738052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.738891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.937083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.946146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e07b5538-f312-4ef0-8953-e9a790d350bc tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.228733 Aug 24 03:37:04.946892 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 254/512] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:04 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:05.280197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.282571 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.303245 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.304756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.306374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.308345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.310497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.312655 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.453454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.454394 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.461415 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.462129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.462579 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.463475 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.463945 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.464376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.537881 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.568098 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.572334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.576573 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-298dd614-726f-43cc-8eae-a4feb823aa49 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.302768 Aug 24 03:37:05.577977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 259/513] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:05.612143 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.613892 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.627151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.628266 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.629041 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.630537 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.631416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.632197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.685905 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.694859 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ccddf51a-7832-4e03-8e73-2ba646760f9a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.246275 Aug 24 03:37:05.695471 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 255/514] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:05.726249 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.735808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ea870833-44aa-4e62-87e6-732c42f76703 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.131406 Aug 24 03:37:05.736413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 260/515] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:05.973907 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.975044 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.986310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.987202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.987962 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.989239 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.990056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.990875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.167970 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.183029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a11ac1ed-44f1-4d87-8c09-9448c8aeee90 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.216051 Aug 24 03:37:06.184041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 256/516] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:06.609068 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.611329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.622199 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.622907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.623340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.624164 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.624705 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.625142 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.733457 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.734118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.749177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.750139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.759041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.760416 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.761154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.761827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.873022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.894638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.897938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.900788 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-59b44968-efe9-41f2-bb86-ffea088a2321 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.298822 Aug 24 03:37:06.902337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 261/517] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:06.912455 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.913611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.926847 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.928007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.928843 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.932170 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.933225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.933834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.005264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:07.020311 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d4364613-91d8-4cb0-aa01-2c3f9a81a39a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.290732 Aug 24 03:37:07.021152 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 257/518] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:07.054703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:07.067798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3f28e030-7471-4349-8e9b-56918db3c9c9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.163829 Aug 24 03:37:07.068764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 262/519] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:07.217782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.218428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:07.225504 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.226039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.226490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.227295 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.227737 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.228172 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.430568 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:07.440567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d17ecc79-671b-41ff-98df-c09809f38234 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.227062 Aug 24 03:37:07.441315 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 258/520] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:07 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:07.948403 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.950774 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:07.963680 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.964606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.965369 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.966783 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.967643 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.968367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.050293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:08.051496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:08.060791 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.061483 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.062016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.062989 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.063585 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.064163 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.238909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.260367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.265977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.270058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-87a484ff-f56f-45ca-900b-a5c3fd4108a3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.327634 Aug 24 03:37:08.288412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 263/521] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:07 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:08.310114 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:08.311376 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:08.342552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.343460 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.344195 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.345422 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.346210 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.346940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.539531 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.544852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.552456 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-25ca10da-977f-4607-80ab-95da4dd9f72a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.261361 Aug 24 03:37:08.554194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 264/522] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:08 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:08.563806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:08.565253 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:08.586004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.587350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.588081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.589268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.590025 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.591050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.595009 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9b9d369c-d11e-4941-93cc-cb51dd23bd45 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.549252 Aug 24 03:37:08.598714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 259/523] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:08 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:08.803612 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.820995 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-610e3004-7b0a-4841-af37-74db4b110dd1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.264792 Aug 24 03:37:08.822061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 265/524] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:08 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:09.323201 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.324557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.337896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.338885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.339665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.341048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.341893 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.342775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.507325 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.517906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.519481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.520691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bbf9b2cb-b861-4daf-8776-328966998c62 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.205181 Aug 24 03:37:09.521279 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 260/525] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:09.580611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.581297 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.589483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.590225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.593818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.595842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.597838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.598774 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.635427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.636582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.647310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.648124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.648863 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.650083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.650895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.651640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.680057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:09.704514 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.714463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-243a1b03-05e7-4df8-b901-629641167126 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.139185 Aug 24 03:37:09.715414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 266/526] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:09.836039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.847098 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.848319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.848506 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9fe276af-88c7-4534-873d-21ccf2d9364d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.220245 Aug 24 03:37:09.849387 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 261/527] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:09.856510 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.857010 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.857523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.858495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.859190 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.859767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.030174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.038691 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6897ddea-38f8-4c7e-98b4-08d4028b714a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.198540 Aug 24 03:37:10.039306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 267/528] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:10.546279 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.546992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.554293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.554851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.555276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.556009 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.556456 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.556877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.748619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.752674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.753688 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.757261 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=4 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:10.763236 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.764922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.765465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.766015 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.766500 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.766721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cc9c7999-6e0a-439a-936d-39b0146843c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.224422 Aug 24 03:37:10.767381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 262/529] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:10.767799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.768538 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.768985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.788077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:10.839051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.848051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-bc4ffa3b-185a-4a7d-bdd9-c644a971c6c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.102689 Aug 24 03:37:10.848660 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 268/530] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:10.876448 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.877520 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.888843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.889676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.890433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.891741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.892561 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.893325 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.049029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.058799 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f85dc75c-3635-40fb-a034-cd4852dadf48 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.190253 Aug 24 03:37:11.060228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 263/531] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:11.062035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.062862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.065572 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=20 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:11.072781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.073458 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.074150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.075122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.075947 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.076400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.247623 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.257764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1c8ce94c-da8f-49bd-91a6-a8285a5f16c7 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.201303 Aug 24 03:37:11.258592 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 269/532] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:11.795362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.796406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.805447 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.805945 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.806387 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.807155 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.807618 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.808048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.873648 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.874784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.882982 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.883534 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.884021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.884919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.885628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.886344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.977244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.992327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e3d02049-724b-44ec-99bd-43f0ae6bd619 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.122689 Aug 24 03:37:11.993422 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 270/533] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:12.010035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.021681 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.023337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.024574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-60a1dd0a-5137-479c-9530-25e2aaa5db5e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.236130 Aug 24 03:37:12.025168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 264/534] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:12.085272 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.086032 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:12.093590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.094101 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.094545 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.095515 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.095989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.096426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.272820 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.282038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7d89d322-226e-4cc5-9c62-3b779cc4ba82 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.200738 Aug 24 03:37:12.282623 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 271/535] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:12 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:12.284642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.285797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:12.296267 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.297282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.298088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.298832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.299503 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.300034 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.459497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.468986 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-36a66e31-a587-4d45-82ce-ef7cece98bcd tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1370 microversion: 2.1 time: 0.191810 Aug 24 03:37:12.469586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 265/536] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:12 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:13.023068 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.023967 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.033021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.033755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.034262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.035139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.035728 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.036277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.050524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.051466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.061520 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.062639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.063545 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.064900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.065865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.066550 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.131107 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.140586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-58063d49-d4bf-4ec1-9a2b-fa6b3db522f9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1262 microversion: 2.1 time: 0.122268 Aug 24 03:37:13.150787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 272/537] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1262 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:13.289161 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.304191 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.307139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.307428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.308508 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.309927 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f8454f23-4b7f-4fcb-a60a-6a76ef3b6502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.263428 Aug 24 03:37:13.322699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 266/538] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:13.322996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.322996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.322996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.322996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.323626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.323626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.492691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.494120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.504108 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.504878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.505426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.505579 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.506777 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.507524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.508229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.522707 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7525a78a-c0bd-4b11-8f9a-6f14ddf7643a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.222023 Aug 24 03:37:13.523872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 273/539] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:13.717898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.737664 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f3be6067-477b-4731-8f7d-a4835f8482fa tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1565 microversion: 2.1 time: 0.249937 Aug 24 03:37:13.751569 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 267/540] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1565 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:13.775005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.776346 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.789864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.791174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.792029 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.793355 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.794482 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.795543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.847920 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-64d8faeb-556c-4444-b33f-946e45926ab6 req-fae472a3-32d4-45cd-81d7-d12f6fdd8720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6083e5a4-9007-400d-be65-91cc4ca5cbdd", "tag": "bbb119e3-75ba-4591-bcb8-4c4696521c7b"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:13.866542 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-64d8faeb-556c-4444-b33f-946e45926ab6 req-fae472a3-32d4-45cd-81d7-d12f6fdd8720 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.867666 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-64d8faeb-556c-4444-b33f-946e45926ab6 req-fae472a3-32d4-45cd-81d7-d12f6fdd8720 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.868903 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-64d8faeb-556c-4444-b33f-946e45926ab6 req-fae472a3-32d4-45cd-81d7-d12f6fdd8720 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.884344 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-64d8faeb-556c-4444-b33f-946e45926ab6 req-fae472a3-32d4-45cd-81d7-d12f6fdd8720 service nova] Creating event network-changed:bbb119e3-75ba-4591-bcb8-4c4696521c7b for instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd on hv-cinder-85426 Aug 24 03:37:13.890060 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-64d8faeb-556c-4444-b33f-946e45926ab6 req-fae472a3-32d4-45cd-81d7-d12f6fdd8720 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047472 Aug 24 03:37:13.891041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 268/541] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:13.913759 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4f640710-f5fc-4532-aa75-ffda55c04803 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144011 Aug 24 03:37:13.914630 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 274/542] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:14.165819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:14.166758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:14.174973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.175610 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.176202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.177209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.178191 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.178923 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.261401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.285507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-be346e2c-19df-41c0-ae9f-b5a3d8856f2d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1254 microversion: 2.1 time: 0.124972 Aug 24 03:37:14.287947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 269/543] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:14 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1254 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:14.351599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:14.352466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:14.359971 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.360548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.361122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.362031 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.362573 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.363223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.559655 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:14.560289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:14.567626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.568294 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.568726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.569507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.570111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.570815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.010774 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.012357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.028336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.029991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6045001c-8e98-4c10-b6d0-c75459030aad tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.473476 Aug 24 03:37:15.031076 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.033340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e2120df0-c035-49dc-910b-e97670d4a8cf tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.686435 Aug 24 03:37:15.049633 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 275/544] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:14 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:15.050204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 270/545] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:14 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:15.340028 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:15.341235 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:15.354228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.355154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.355920 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.357145 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.357930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.358685 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.465523 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.474398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ffd03926-8c36-4d63-8d68-e2b27e6179fe tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1254 microversion: 2.1 time: 0.141851 Aug 24 03:37:15.475012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 276/546] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:15 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1254 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:15.636927 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-41730028-0052-4dd7-b5a9-6776d8b28e6e req-f527bd39-7ffc-4008-9087-057405f8c953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f097f4-3522-408a-b729-f895148b7fbb", "tag": "c6ee4054-246d-400d-a193-9ca2efe2b6d1"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:15.649959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-41730028-0052-4dd7-b5a9-6776d8b28e6e req-f527bd39-7ffc-4008-9087-057405f8c953 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.650444 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-41730028-0052-4dd7-b5a9-6776d8b28e6e req-f527bd39-7ffc-4008-9087-057405f8c953 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.650914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-41730028-0052-4dd7-b5a9-6776d8b28e6e req-f527bd39-7ffc-4008-9087-057405f8c953 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.663840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-41730028-0052-4dd7-b5a9-6776d8b28e6e req-f527bd39-7ffc-4008-9087-057405f8c953 service nova] Creating event network-changed:c6ee4054-246d-400d-a193-9ca2efe2b6d1 for instance 89f097f4-3522-408a-b729-f895148b7fbb on hv-cinder-85426 Aug 24 03:37:15.669458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-41730028-0052-4dd7-b5a9-6776d8b28e6e req-f527bd39-7ffc-4008-9087-057405f8c953 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039172 Aug 24 03:37:15.670088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 271/547] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:16.065544 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.066635 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.070446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.071739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.080697 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.081177 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.081624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.082334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.082811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.082955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.083228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.083714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.084519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.086400 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.086569 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.087354 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.302883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.312320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.316946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.319415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.320844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a0916f13-50b0-4273-b45f-4583802a6bbb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.264782 Aug 24 03:37:16.321660 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 277/548] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:16 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:16.323731 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-48f6ea57-33f9-490e-8dce-666bb37f40da tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.261625 Aug 24 03:37:16.324330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 272/549] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:16 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:16.509340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.511178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.518635 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.519173 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.519614 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.520343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.520786 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.521209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.597765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.606064 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-331780d8-6a2c-4701-80fb-41b7fbc8191b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1254 microversion: 2.1 time: 0.100760 Aug 24 03:37:16.606894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 278/550] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:16 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1254 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:17.356692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.357655 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.358729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.359732 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.368567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.369346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.369703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.370062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.370621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.371272 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.371999 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.373222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.373380 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.373841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.374021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.374496 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.604449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.607765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.617827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.618058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-bbfdabaa-5913-4cdc-b9c4-a65b46dcccda tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.265562 Aug 24 03:37:17.618777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 279/551] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:17.619909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.621353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d101ec60-1abd-4e3a-809b-562bbeee4091 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.271336 Aug 24 03:37:17.622730 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 273/552] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:17.627782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.628427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.635735 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.636443 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.637043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.638020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.638767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.639211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.714688 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.723671 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3a2c27b5-492b-4893-be3f-79fc743fd206 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1254 microversion: 2.1 time: 0.099657 Aug 24 03:37:17.724305 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 280/553] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1254 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:18.646776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.648278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.651236 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.653923 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.656065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.656951 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.657645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.658612 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.659962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.660563 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.666057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.667015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.667901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.670135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.671247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.672118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.961557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.975268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2a641f79-c30f-4093-9ac6-cb9762c37d9b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.332399 Aug 24 03:37:18.977451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 281/554] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:18.985365 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.987750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.988415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.997953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.998771 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.999751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.001243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.002333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.003372 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.006468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.009954 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.012594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f32e2968-f547-4812-b569-30e38b8df0c8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.369655 Aug 24 03:37:19.014992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 274/555] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:19.098871 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.115907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d3f31786-5942-450b-9eeb-e4515a2a7a52 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1310 microversion: 2.1 time: 0.136358 Aug 24 03:37:19.116953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 282/556] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1310 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.016657 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.017753 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.054066 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.054615 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.055418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.056883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.060116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.066355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.069088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.071847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.073925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.075112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.076021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.077421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.078473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.079579 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.494548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.510503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.512690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.514103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-73318465-1722-496b-8645-dfe629b2e240 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.472580 Aug 24 03:37:20.520281 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 283/557] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:20.540541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.541694 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.552120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.552912 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.553604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.554720 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.555587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.556266 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.619720 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.658644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cc93b1a8-c80b-4dd7-acf5-ca7cfb37bb40 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.649004 Aug 24 03:37:20.679785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 275/558] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.720539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.731195 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9cb818ad-8485-4394-899c-669f680e1c9e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1316 microversion: 2.1 time: 0.208997 Aug 24 03:37:20.744531 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 284/559] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:21.504291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.507305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.523672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.525732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.528255 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.540899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.542251 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.543396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.546036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.551340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.573585 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.575322 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.576257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.577638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.578406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.579060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.608841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:21.775309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lazy-loading 'services' on Instance uuid 6d705a9b-3c26-4e94-b89e-a23a4c38320d {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:21.810193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.840046 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.842942 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.845972 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cc7b9be8-14b1-46c5-8b94-28041769b74d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.307032 Aug 24 03:37:21.868235 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 285/560] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:21.896490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.897861 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.911733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.913290 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.914349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.915807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.916952 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.917838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.992150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-56a02436-6ef2-4d43-a1d6-b350e44868cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-volume_attachments/da68b0cb-5674-4d12-b086-470f3f03d6e7" status: 202 len: 0 microversion: 2.1 time: 0.497679 Aug 24 03:37:21.993008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 276/561] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:37:21 2022] DELETE /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-volume_attachments/da68b0cb-5674-4d12-b086-470f3f03d6e7 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:22.004811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.006411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.026479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.027761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.028674 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.030340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.031353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.032230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.218291 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.249790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.256420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0a2417aa-657e-4613-a62a-2fb721b977ac tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.386327 Aug 24 03:37:22.257102 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 286/562] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.261552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-aca2dace-60c6-4c7d-a065-7571f83ffe50 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.266470 Aug 24 03:37:22.271330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 277/563] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.902680 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.904426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.914151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.915227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.916045 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.917266 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.918139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.918943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.172154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.183368 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-0b4e694a-b950-4fe9-9ec0-5845471d18b2 req-5ce60c62-9d48-4248-bbb3-de0d60098360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaca649f-ad0a-4355-b741-7e46388c74cd", "name": "network-vif-plugged", "status": "completed", "tag": "f8a2d888-1c8d-4395-a171-9a83d1745a85"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:23.203438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.205637 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.207036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-581a2f54-6f0f-43c6-b398-2376806b0562 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.310615 Aug 24 03:37:23.207652 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 287/564] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:23.212103 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0b4e694a-b950-4fe9-9ec0-5845471d18b2 req-5ce60c62-9d48-4248-bbb3-de0d60098360 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.213237 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0b4e694a-b950-4fe9-9ec0-5845471d18b2 req-5ce60c62-9d48-4248-bbb3-de0d60098360 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.217885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0b4e694a-b950-4fe9-9ec0-5845471d18b2 req-5ce60c62-9d48-4248-bbb3-de0d60098360 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.247760 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-0b4e694a-b950-4fe9-9ec0-5845471d18b2 req-5ce60c62-9d48-4248-bbb3-de0d60098360 service nova] Creating event network-vif-plugged:f8a2d888-1c8d-4395-a171-9a83d1745a85 for instance aaca649f-ad0a-4355-b741-7e46388c74cd on hv-cinder-85426 Aug 24 03:37:23.256154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-0b4e694a-b950-4fe9-9ec0-5845471d18b2 req-5ce60c62-9d48-4248-bbb3-de0d60098360 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088706 Aug 24 03:37:23.257714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 278/565] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:23.301912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.303282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.303613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.304745 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.315943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.316616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.317114 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.317250 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.317947 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.318087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.318586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.319079 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.327494 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.328482 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.329269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.330513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.375110 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:23.742336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.763174 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-39014e98-a246-4eb8-b1dd-908659255d74 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.472733 Aug 24 03:37:23.772613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.779329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 279/566] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:23.799319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e357f26d-c888-4183-87d3-cf3868c3f30b tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.511465 Aug 24 03:37:23.800739 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 288/567] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:24.232919 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.233723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.243696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.244372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.244947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.245946 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.246685 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.247441 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.587204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.601269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.604499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.606852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-743e22d0-d02b-4350-8b86-fe6eb11289be tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.378076 Aug 24 03:37:24.608432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 280/568] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:24.801240 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.802268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.811170 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.811695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.812145 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.812898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.813413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.813845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.839704 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.840011 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.848828 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.849643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.850302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.851298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.851944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.852518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.204360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.220855 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4299168b-580b-4d54-965c-d2c43209cbc0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.424067 Aug 24 03:37:25.237278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 289/569] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:25.242080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.263817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-315d9c62-9833-4c1d-8f21-172298641a75 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.429028 Aug 24 03:37:25.265847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 281/570] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:25.644175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.645392 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:25.654592 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.655650 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.656388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.657647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.658461 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.659203 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.859587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.869698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.871332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.872678 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5c974aa2-6f71-42c8-a0a5-4e92fef9f21d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.235879 Aug 24 03:37:25.873278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 290/571] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:26.263543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.265702 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.276895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.278823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.279796 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.281763 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.282522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.283342 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.296350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.297745 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.323498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.324684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.326038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.327513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.328463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.329345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.626695 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.648834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.649109 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9a5fae72-3279-48d2-9e9d-3523929b69bc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.391745 Aug 24 03:37:26.649109 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 282/572] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:26.652548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-af9f7c37-55aa-4867-a9c1-dd28ab2ed8bf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.363989 Aug 24 03:37:26.655266 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 291/573] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:26.901436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.902865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.905959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=82 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:26.915728 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.916563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.917351 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.918591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.919427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.920170 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.171142 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.182345 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.184462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.185735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c0831546-c2dc-4675-bca0-8ce2b0efd889 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.291979 Aug 24 03:37:27.186351 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 283/574] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:27.686336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.687476 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.700764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.702036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.702821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.704038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.705055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.705785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.783562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.785057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.798768 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.800102 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.801175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.802836 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.804213 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.805182 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.091046 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.110430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a5635b0c-3b10-470b-945f-893664aeebc1 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.432837 Aug 24 03:37:28.111970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 292/575] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:28.157043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.173797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9a6bddb2-dff3-4070-a53f-46af24193813 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.396227 Aug 24 03:37:28.175423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 284/576] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:28.211489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:28.212283 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:28.221020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.221516 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.221953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.222732 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.223198 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.223827 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.503792 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.522126 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.525785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.532211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8c7f5a1f-603a-4d42-9718-7b2bd80f77d4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.325407 Aug 24 03:37:28.532907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 293/577] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:28 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:29.139165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.140116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.152542 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.154096 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.155248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.157368 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.158785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.159885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.216383 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.219057 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.229286 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.229932 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.230772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.231760 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.232350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.232874 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.532208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.549259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.570504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5e09d16f-e0ca-4bac-a2df-44052d4d44d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.360170 Aug 24 03:37:29.577218 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-acb6c344-761e-4573-9201-0d17cccb5b6c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.443005 Aug 24 03:37:29.587231 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 285/578] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:29.591753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 294/579] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:29.618052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.619252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.629894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.630714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.631394 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.632516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.633238 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.633896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.025538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.041831 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.045026 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.046924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-944b1b0c-30d8-4687-aee7-d3b94559527c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.441871 Aug 24 03:37:30.047773 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 286/580] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:30.623517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:30.624687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:30.627361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:30.628239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:30.637899 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.638781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.639543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.640080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.640795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.640958 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.641440 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.641716 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.643032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.643856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.644693 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.928073 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.943543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-be55d257-7a07-457d-ae09-045333589e11 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.341394 Aug 24 03:37:30.957830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 295/581] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:30 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:31.004569 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.020259 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-874991f9-3606-4447-8d84-0d26259f385a tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.402479 Aug 24 03:37:31.021138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 287/582] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:30 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:31.072799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:31.073751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:31.082059 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.082719 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.083336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.084234 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.084794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.085309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.308340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.319405 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.321008 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.322232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4f16f5a9-2422-4e82-8445-b376723d64df tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.254154 Aug 24 03:37:31.322873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 296/583] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:31 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:31.974518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:31.975749 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:31.986033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.986886 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.987065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.987794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.988250 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.988681 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.045607 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.046751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:32.054313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.054934 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.055321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.056269 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.056748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.057192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.224684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.235118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-96b13068-6407-4aa7-8a68-ff26f4c12a1b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.271168 Aug 24 03:37:32.235907 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 288/584] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:31 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:32.258175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.267567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-540bc5bd-bf48-4c46-8d64-c3f58891806f tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.226604 Aug 24 03:37:32.268174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 297/585] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:32 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:32.347271 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.347880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:32.355066 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.355795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.356450 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.357105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.357595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.358059 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.522025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.533371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.535289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.536640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ecbdb82c-4c43-48c5-b364-2910e3b3d322 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.193746 Aug 24 03:37:32.537252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 289/586] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:32 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:33.269599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.270251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.278065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.278595 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.279093 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.279887 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.280447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.280910 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.293893 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.295306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.307487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.308402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.310542 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.311923 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.312741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.313472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.497819 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.509662 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-af82f5ea-df34-44a2-a1c8-647f7b612982 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.243967 Aug 24 03:37:33.510686 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 298/587] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:33.531827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.541261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6018e6ac-1574-48c4-96db-daa277813762 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.254619 Aug 24 03:37:33.542006 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 290/588] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:33.561639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.562507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.572837 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.574427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.575368 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.577325 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.578342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.579490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.741311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.751369 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.752876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.754069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3f963fec-f7ce-444f-a101-1b32ae5ee6f0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.197656 Aug 24 03:37:33.754691 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 299/589] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:34.536720 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.537580 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.546059 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.546615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.547183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.547947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.548454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.548947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.578938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.580051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.584479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=83 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:34.595115 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.596036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.596812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.598419 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.598894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.599621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.821543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.832925 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2edaab2a-49bd-4e24-af57-6ecfded794b1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.300567 Aug 24 03:37:34.833606 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 291/590] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:34 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:34.838957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.839835 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.847866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.848402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.849091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.849840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.850305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.850807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.921638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.938845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c5a8b6b5-506d-4acd-a8ce-4d577f42cd54 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.366393 Aug 24 03:37:34.939987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 300/591] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:34 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:35.020899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.032326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.034018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.035284 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2d341f14-775d-4b0e-bb29-47d0b31206bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.200703 Aug 24 03:37:35.035906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 292/592] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:34 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:35.868948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.869948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.882155 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.883253 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.884043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.885281 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.886136 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.887034 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.977561 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.978516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.990895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.992913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.992913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.993903 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.994789 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.995565 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.159330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.180696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a1a4a0a7-076a-49d9-ae0b-666ff4d8c310 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.319087 Aug 24 03:37:36.181618 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 301/593] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:36.188041 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.188937 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.198969 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.199869 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.200598 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.201825 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.202495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.203109 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.206911 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:36.239927 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.253680 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-90f85049-7de0-4965-a3c7-a2f387024566 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.280455 Aug 24 03:37:36.254364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 293/594] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:36.478236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.494463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.496474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.498069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5dc4a251-fea4-4307-b56c-eb3ed1714c3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.315369 Aug 24 03:37:36.498894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 302/595] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:36 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:37.221853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.222562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.230928 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.231565 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.232169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.233378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.233946 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.234442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.285932 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.286994 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.297759 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.299014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.300016 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.303480 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.304452 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.305539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.510179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.525302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3f36319a-3b76-45d0-bb03-e4e3d63edfd9 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.307093 Aug 24 03:37:37.527283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 294/596] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:37.535859 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-c0e05ae8-07d3-451f-b16b-630777bde643 req-27a526ae-83d8-48fa-a81d-0b76cdf3d31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b212009b-b39e-44d4-901f-dae732632529", "tag": "8f793c88-f2e7-4c15-84bf-8bcd6407f687"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:37.552820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c0e05ae8-07d3-451f-b16b-630777bde643 req-27a526ae-83d8-48fa-a81d-0b76cdf3d31e service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.553665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c0e05ae8-07d3-451f-b16b-630777bde643 req-27a526ae-83d8-48fa-a81d-0b76cdf3d31e service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.554695 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c0e05ae8-07d3-451f-b16b-630777bde643 req-27a526ae-83d8-48fa-a81d-0b76cdf3d31e service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.572162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.575744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-c0e05ae8-07d3-451f-b16b-630777bde643 req-27a526ae-83d8-48fa-a81d-0b76cdf3d31e service nova] Creating event network-changed:8f793c88-f2e7-4c15-84bf-8bcd6407f687 for instance b212009b-b39e-44d4-901f-dae732632529 on hv-cinder-85426 Aug 24 03:37:37.584287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-c0e05ae8-07d3-451f-b16b-630777bde643 req-27a526ae-83d8-48fa-a81d-0b76cdf3d31e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054549 Aug 24 03:37:37.585037 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1ea43116-6e5e-4791-a73f-f76df03bd512 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.303757 Aug 24 03:37:37.585347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 295/597] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:37.589798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 303/598] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:37.599003 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.600259 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.621458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.622093 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.622608 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.623490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.623971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.624402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.780146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.782570 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:37.791340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.792894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.794311 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8e54d8f4-9b9f-44c2-abd8-9505983a2e4e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.207427 Aug 24 03:37:37.794924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 296/599] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:38.556672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.557659 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.566029 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.566533 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.567018 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.567817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.568348 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.568773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.613200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.614121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.627530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.628420 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.629253 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.630706 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.632333 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.633171 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.898336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.907369 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c4661134-d30e-4103-8d19-620637a1b0b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.354872 Aug 24 03:37:38.908004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 304/600] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:38.913017 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.913645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.921490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.921989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.922419 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.923183 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.923915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.924349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.952005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.961304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-18978bc3-b05a-4eef-9130-a373c35f3c77 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.352095 Aug 24 03:37:38.962083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 297/601] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:39.124977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.136966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.138579 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.139893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d18e97d9-9fb3-46bc-a30a-3c2b60d5019d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.230929 Aug 24 03:37:39.140483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 305/602] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:39.934867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:39.935754 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.944165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.944683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.945128 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.946762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.947420 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.947993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.989530 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:39.990997 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.999800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.000549 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.000984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.002071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.002591 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.003151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.268852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.280914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-54466b28-3c1f-422c-a68e-0a3a929c92d1 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.350906 Aug 24 03:37:40.282020 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 298/603] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:39 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:40.291442 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.297521 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.299085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.307647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4163f702-53b2-41bd-ae52-808422decf63 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.327315 Aug 24 03:37:40.309753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 306/604] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:39 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:40.310574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.311697 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.312567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.313925 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.314917 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.315742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.498045 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.508819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.510519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.512186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-da55b4eb-7dcb-44f9-a28a-c7bec9a95bff tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.222429 Aug 24 03:37:40.513058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 299/605] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:41.314547 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.315425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.323547 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.324848 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.325112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.325987 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.326540 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.327150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.345207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.346193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.356551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.357189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.357818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.358759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.359444 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.359970 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.858384 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.871405 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.873632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-01bd9193-76b0-44f4-b820-c9a9871972a3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.563037 Aug 24 03:37:41.874716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 307/606] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:41.889431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.889746 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1d804ceb-8fdb-4905-b157-a12644f7c7cf tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.551169 Aug 24 03:37:41.890063 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.891634 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 300/607] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:41.905054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.905927 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.906678 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.907996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.909438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.910099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.984208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8fdcbf2b-c7ee-4c22-88cd-a70e0288262a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:41.997023 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf2b-c7ee-4c22-88cd-a70e0288262a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.003626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf2b-c7ee-4c22-88cd-a70e0288262a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.006378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf2b-c7ee-4c22-88cd-a70e0288262a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.051179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8fdcbf2b-c7ee-4c22-88cd-a70e0288262a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Going to try to stop instance {{(pid=127258) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:37:42.112454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.130231 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8fdcbf2b-c7ee-4c22-88cd-a70e0288262a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action" status: 202 len: 0 microversion: 2.1 time: 0.153316 Aug 24 03:37:42.130494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.130972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 301/608] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:37:41 2022] POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:37:42.133264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.135429 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7e8c36a6-18eb-404b-b77c-6d5dfa9b6a59 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.256176 Aug 24 03:37:42.136495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 308/609] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:42.150436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.152030 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.163891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.164477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.164982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.165844 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.166375 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.166908 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.338955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.348595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f36c19fa-c613-4973-9b33-8464b37ff841 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.212280 Aug 24 03:37:42.349481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 302/610] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:42 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:42.917220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.921395 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.926145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.926877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.935692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.936270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.936826 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.937629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.938097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.938527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.939377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.940624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.941535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.942889 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.943746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.944561 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.206601 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.217765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.221907 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-65356d2b-9695-435b-9d00-945e3bd83332 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.301197 Aug 24 03:37:43.222977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 303/611] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:42 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:43.226229 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ded9d60b-68e5-4a00-9443-155734136ff0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.321365 Aug 24 03:37:43.226837 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 309/612] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:42 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:43.232414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.233497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.244466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.245582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.246522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.247642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.248493 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.249305 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.373072 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.373697 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.380698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.381197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.381640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.382368 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.382874 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.383307 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.427932 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.448023 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.452312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.454596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9de0584e-6773-4d9c-bb6d-9410ec6da298 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.229848 Aug 24 03:37:43.474698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 304/613] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:43.568243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.585720 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e8a8bfaa-3dfd-40db-b4e6-c68e24bc0629 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.216772 Aug 24 03:37:43.587270 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 310/614] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:43.686436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-98328232-c9d9-44b4-8e9a-221074d27d8d req-7f384fb5-e7d1-49bf-af0d-ce94382ef591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6083e5a4-9007-400d-be65-91cc4ca5cbdd", "name": "network-vif-plugged", "status": "completed", "tag": "bbb119e3-75ba-4591-bcb8-4c4696521c7b"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:43.709870 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-98328232-c9d9-44b4-8e9a-221074d27d8d req-7f384fb5-e7d1-49bf-af0d-ce94382ef591 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.712216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-98328232-c9d9-44b4-8e9a-221074d27d8d req-7f384fb5-e7d1-49bf-af0d-ce94382ef591 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.713419 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-98328232-c9d9-44b4-8e9a-221074d27d8d req-7f384fb5-e7d1-49bf-af0d-ce94382ef591 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.745368 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-98328232-c9d9-44b4-8e9a-221074d27d8d req-7f384fb5-e7d1-49bf-af0d-ce94382ef591 service nova] Creating event network-vif-plugged:bbb119e3-75ba-4591-bcb8-4c4696521c7b for instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd on hv-cinder-85426 Aug 24 03:37:43.755857 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-98328232-c9d9-44b4-8e9a-221074d27d8d req-7f384fb5-e7d1-49bf-af0d-ce94382ef591 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077895 Aug 24 03:37:43.757341 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 305/615] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:44.253678 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.254628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.262736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.263608 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.264332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.265322 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.265828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.266107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.266349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.267414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.278559 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.279851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.280810 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.282307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.283435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.284425 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.633820 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.646781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0bc0a17d-c120-4376-8956-d68372e64a37 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.397869 Aug 24 03:37:44.647363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 311/616] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:44.650959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.652885 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.653702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.662113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.662956 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.663670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.664872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.665072 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-672e972c-dff4-4797-8139-94e85a8d4861 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.407605 Aug 24 03:37:44.665664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.666159 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 306/617] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:44.667068 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.675293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.676397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.689499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.690366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.691202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.692516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.693625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.694707 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.895872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.913195 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.916966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.920255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c765e7b7-33a7-4b93-b697-5002b4ea7e17 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.271432 Aug 24 03:37:44.921337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 312/618] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:44.942267 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.951545 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7f8e8017-95c1-4ee2-b67d-7b0eb8561faa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.283839 Aug 24 03:37:44.952145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 307/619] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:45.678901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.679998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.690438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.691204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.693593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.694431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.695257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.696570 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.697404 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.698261 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.698597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.699212 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.699905 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.700645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.701123 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.701546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.924936 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.939776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-113050c8-cbd9-40f5-a587-3a5580b6f853 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.268658 Aug 24 03:37:45.940831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 313/620] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:45.953761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.954186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.954821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.961293 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.961798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.962228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.962991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.963453 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.963915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.969195 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1f811172-eaab-4479-a5e1-f0bb0a7520b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.282351 Aug 24 03:37:45.970224 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 308/621] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:45.979091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.980310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.991388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.992270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.993058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.994384 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.995263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.996031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.204144 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.204433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.212969 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cdd1ba8a-f3d8-496d-a8a5-366898f11376 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.241227 Aug 24 03:37:46.213563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 309/622] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:46.220697 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.223807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.226035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-801ff705-65e3-4f6f-8d95-cfa6195bbfeb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.275800 Aug 24 03:37:46.227096 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 314/623] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:46.963320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.963966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.972073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.972578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.973018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.973750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.974208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.974637 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.992759 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.993826 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.002733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.003447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.003957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.004726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.005324 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.005839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.196624 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.207485 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ee732ae7-fe18-4a11-93de-4e4f3538dfd9 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.248598 Aug 24 03:37:47.208092 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 310/624] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:47.234309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.235881 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.236543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.242642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.242908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e244e379-bb03-43f0-b92d-57523c1fd38f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.254697 Aug 24 03:37:47.243167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.243485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 315/625] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:47.243676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.244416 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.244880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.245467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.267887 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.269154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.277742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.278408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.279100 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.280014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.280600 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.281115 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.455567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.464323 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0dfe09fb-762d-43a5-a228-baebcca2fe63 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.232148 Aug 24 03:37:47.465398 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 311/626] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:47.489435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.503124 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.504828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.506849 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-22932f16-4086-451b-9248-e9e54b428bab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1809 microversion: 2.20 time: 0.245428 Aug 24 03:37:47.507666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 316/627] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:48.230268 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.231136 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.238489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.239024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.239486 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.240204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.240662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.241098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.268981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.270014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.280311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.281046 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.281758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.282905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.283576 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.284313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.462218 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.473269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5ba4cd96-a50a-4eda-80e7-10c159f36e36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1319 microversion: 2.1 time: 0.247118 Aug 24 03:37:48.474350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 312/628] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.486217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.486742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.493400 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.493882 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.494347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.495158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.496049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.496199 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.499357 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:48.507015 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.520751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-35ef5a1e-772b-418e-9351-e92accf00c35 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.258234 Aug 24 03:37:48.521587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 317/629] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.538835 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.539983 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.551276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.552152 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.552952 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.554472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.555794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.556568 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.717227 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.726817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b49dc29d-03a6-414a-9f07-4ca7b5cd36dd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.244443 Aug 24 03:37:48.727478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 313/630] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.778199 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.780977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:48.791357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.793344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.794636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b8e43cb5-2786-4ae9-ae59-09359cf34721 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1796 microversion: 2.20 time: 0.263903 Aug 24 03:37:48.795335 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 318/631] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1796 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:49.512275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.513281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.521875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.522539 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.523064 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.523857 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.524452 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.525086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.551567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.553746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.570415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.571533 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.572488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.574310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.574310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.575230 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.811972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.821398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.825845 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0daf452d-102d-4c5e-88f9-1691d596460d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1507 microversion: 2.1 time: 0.318950 Aug 24 03:37:49.827054 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 314/632] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:49.842014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0deb288f-3d93-4e1a-adbc-ccd0ad02d92d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.300261 Aug 24 03:37:49.843830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 319/633] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:49.851837 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beab121c-c8e5-4f85-afaf-56675898a005", "device": "/dev/sdb"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:49.857920 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.870376 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.871069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.871612 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.872480 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.873205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.873886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.030606 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.032316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.044807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.045527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.046194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.047613 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.048376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.049042 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.224817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b0ee353b-b3a1-4e28-bfa2-142bd300f70c tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "POST /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378812 Aug 24 03:37:50.225926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 320/634] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:37:49 2022] POST /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:50.300448 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.318112 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4cd2813a-ec36-4d71-9df8-38dca170915b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.488822 Aug 24 03:37:50.319497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 315/635] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:50.867757 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.868391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.876292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.876789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.877233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.877960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.878416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.878876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.034014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.043808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e03fde51-56f7-4434-838a-f81bfc071b60 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.180930 Aug 24 03:37:51.045741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 321/636] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:50 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:51.347901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.349312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:51.357904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.358614 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.359244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.360107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.360701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.361311 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.529787 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.538593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-955843a9-e988-4351-adcb-9fc08bb8e635 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.195606 Aug 24 03:37:51.539348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 316/637] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:52.049360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-9ec5910a-d390-4fc8-831b-1333ccd8b9d3 req-b3db1e64-91ef-451d-984a-8ece77be2584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b212009b-b39e-44d4-901f-dae732632529", "name": "network-vif-plugged", "status": "completed", "tag": "8f793c88-f2e7-4c15-84bf-8bcd6407f687"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:52.069479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9ec5910a-d390-4fc8-831b-1333ccd8b9d3 req-b3db1e64-91ef-451d-984a-8ece77be2584 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.070548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9ec5910a-d390-4fc8-831b-1333ccd8b9d3 req-b3db1e64-91ef-451d-984a-8ece77be2584 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.071406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-9ec5910a-d390-4fc8-831b-1333ccd8b9d3 req-b3db1e64-91ef-451d-984a-8ece77be2584 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.077979 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.079050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.089173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.090212 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.090836 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.092091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.092931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.093440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.095468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-9ec5910a-d390-4fc8-831b-1333ccd8b9d3 req-b3db1e64-91ef-451d-984a-8ece77be2584 service nova] Creating event network-vif-plugged:8f793c88-f2e7-4c15-84bf-8bcd6407f687 for instance b212009b-b39e-44d4-901f-dae732632529 on hv-cinder-85426 Aug 24 03:37:52.106262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-9ec5910a-d390-4fc8-831b-1333ccd8b9d3 req-b3db1e64-91ef-451d-984a-8ece77be2584 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063506 Aug 24 03:37:52.107524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 322/638] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:52.293187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.306782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ec816cbd-91e4-4573-a8cb-a9c42853374c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.234596 Aug 24 03:37:52.308519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 317/639] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:52.570525 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.572512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.585343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.586256 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.599111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.600596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.601483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.602241 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.821737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.832726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a8edccf1-1a86-4f76-841f-b0bc66879f79 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.271558 Aug 24 03:37:52.833666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 323/640] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:53.097411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "beab121c-c8e5-4f85-afaf-56675898a005", "create_info": {"type": "qcow2", "new_file": "volume-beab121c-c8e5-4f85-afaf-56675898a005.122bb74f-76e6-4ef1-8274-aa82f5f93a08.vhdx", "snapshot_id": "122bb74f-76e6-4ef1-8274-aa82f5f93a08"}}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:53.101289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.101809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.102245 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.113664 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.114235 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.114705 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.132428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-2054688d-fd22-4b43-a163-183012c01d1e req-6c25f1ca-f278-4cc3-8e50-7a4b76f6a179 admin admin] 10.222.0.79 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.100126 Aug 24 03:37:53.133057 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 318/641] 10.222.0.79 () {64 vars in 1326 bytes} [Wed Aug 24 03:37:53 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:37:53.345344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.345976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.352950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.353467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.353910 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.355043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.355244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.355616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.515955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.532645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-09387ec6-bcc3-4fbb-9e43-51973ceb809c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.191655 Aug 24 03:37:53.533785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 324/642] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:53.863976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.865149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.878283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.879768 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.880718 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.882074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.882999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.883803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.044630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.053820 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9c041afb-77bf-4a67-ac4c-e0252fb8dc2d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.199281 Aug 24 03:37:54.054446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 319/643] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:54.567853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:54.568650 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:54.580393 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.581193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.581890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.582679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.583190 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.583654 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.748739 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.758854 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dd6cf145-5808-4104-bf9e-8dd2c70b6ef0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1358 microversion: 2.1 time: 0.195160 Aug 24 03:37:54.759484 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 325/644] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:54 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:55.076984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.077936 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.086405 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.087280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.087868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.089538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.090376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.091138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.295191 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.304276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3858654f-98a7-46a1-8cac-f597468e84ab tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.231466 Aug 24 03:37:55.304991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 320/645] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:55.782677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.783449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.791205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.791760 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.792298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.793041 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.793509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.793951 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.965309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.980186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-17425b49-0d6a-4b49-ac81-9e1e39e8509e tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1548 microversion: 2.1 time: 0.200929 Aug 24 03:37:55.981285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 326/646] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1548 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:56.004312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.004954 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.015672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.016250 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.016883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.018177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.019145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.019967 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.190985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.201796 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5be67bae-13a0-4ab5-a349-93f61dc8b17b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1548 microversion: 2.1 time: 0.201975 Aug 24 03:37:56.202408 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 321/647] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:56.224957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.231533 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.232872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Searching by: {'deleted': False, 'project_id': 'f0af57c134de4e0a888e90e50510d915'} {{(pid=127257) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:37:56.244492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.245191 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.245750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.246875 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.247353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.247783 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.332941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.334644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.347068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.347928 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.348668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.349948 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.350778 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.351479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.353844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.multi_cell_list [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:37:56.496056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-89028139-cf5a-4d61-b63a-5256cf91413f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.275129 Aug 24 03:37:56.496056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 327/648] 10.222.0.78 () {58 vars in 1125 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:56.508316 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.508945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.515958 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.516454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.516908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.517647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.518117 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.518619 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.550385 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.564378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a690a58e-75ff-4247-95f7-4ecc81f66ff6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.238614 Aug 24 03:37:56.566094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 322/649] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:56.707713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.717670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0ae4bbe4-b375-4531-8b17-0a9f2bdc2895 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1548 microversion: 2.1 time: 0.213116 Aug 24 03:37:56.718340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 328/650] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:57.614215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:57.615023 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:57.619737 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=78 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:57.630254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.631181 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.631926 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.633173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.633992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.634824 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.857898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.867715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0b46c1fa-c0bc-4fcf-9d6e-29634f9e0d76 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.260279 Aug 24 03:37:57.868160 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 323/651] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:57 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:58.557401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcc9c617-6128-4e4b-b204-8f5ef6173486"}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:58.560691 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.560870 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "beab121c-c8e5-4f85-afaf-56675898a005", "create_info": {"type": "qcow2", "new_file": "volume-beab121c-c8e5-4f85-afaf-56675898a005.7b5fa9fe-b001-4953-9e8f-3e25675044fb.vhdx", "snapshot_id": "7b5fa9fe-b001-4953-9e8f-3e25675044fb"}}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:58.564635 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.565149 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.565603 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.567821 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.568326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.568783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.569555 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.570037 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.570481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.582507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.583062 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.583507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.603329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-3e23a11e-4c9b-46a8-a88e-f585268735b2 req-ddb9b2c7-c98b-4544-877d-d20875a89058 admin admin] 10.222.0.79 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.128815 Aug 24 03:37:58.603957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 329/652] 10.222.0.79 () {64 vars in 1326 bytes} [Wed Aug 24 03:37:58 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:37:58.894087 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.894877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.902700 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.903230 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.903689 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.904446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.904927 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.905353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.076647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:59.088174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-97a484a9-7ea4-4405-aa61-fe8b680b61fa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.198823 Aug 24 03:37:59.089196 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 330/653] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:00.011548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f7b4feff-c67e-4fe4-800f-80f0ec839927 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.458233 Aug 24 03:38:00.012499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 324/654] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:37:58 2022] POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments => generated 194 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:00.124183 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:00.126298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:00.138594 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.139414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.140089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.141220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.141972 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.142636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.381398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.396639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-588d3f9c-8d58-476c-bc7f-9aa2bc1b0e7b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.279200 Aug 24 03:38:00.397700 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 331/655] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:00 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:01.432259 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.434171 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.441649 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.442145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.442585 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.443345 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.443806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.444240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.645597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.657116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4625242c-bc03-44f2-9328-1744afb010cc tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.230365 Aug 24 03:38:01.657726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 325/656] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:02.680256 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:02.681247 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:02.690303 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.690864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.691385 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.692211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.692729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.693241 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.892251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:02.901394 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-04210b97-90ef-4a89-8038-4a6a63b00104 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1677 microversion: 2.1 time: 0.225702 Aug 24 03:38:02.902394 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 332/657] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:02 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:03.688518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:03.756005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:03.759783 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.760263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.760838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.770452 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.770966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.771399 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.787751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-6b6fdf3c-66d9-4b4a-a1ba-8929525f578e req-7bcb7713-77a6-4a3b-8a6a-24f8349d5e99 admin admin] 10.222.0.79 "DELETE /compute/v2.1/os-assisted-volume-snapshots/7b5fa9fe-b001-4953-9e8f-3e25675044fb?delete_info=%7B%22file_to_merge%22:%20%22volume-beab121c-c8e5-4f85-afaf-56675898a005.7b5fa9fe-b001-4953-9e8f-3e25675044fb.vhdx%22,%20%22volume_id%22:%20%22beab121c-c8e5-4f85-afaf-56675898a005%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.106392 Aug 24 03:38:03.788362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 326/658] 10.222.0.79 () {62 vars in 1800 bytes} [Wed Aug 24 03:38:03 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/7b5fa9fe-b001-4953-9e8f-3e25675044fb?delete_info=%7B%22file_to_merge%22:%20%22volume-beab121c-c8e5-4f85-afaf-56675898a005.7b5fa9fe-b001-4953-9e8f-3e25675044fb.vhdx%22,%20%22volume_id%22:%20%22beab121c-c8e5-4f85-afaf-56675898a005%22%7D => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:38:03.926860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:03.927925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:03.936803 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.937479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.938106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.939006 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.939550 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.940157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.095322 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:04.104038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c2b6a05f-0459-48a4-9a38-19e77ce966df tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1654 microversion: 2.1 time: 0.182185 Aug 24 03:38:04.105332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 333/659] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:03 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1654 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:04.126912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8423bcac-97d4-478b-b79a-54ba36afeb13 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:04.133821 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8423bcac-97d4-478b-b79a-54ba36afeb13 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.134322 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8423bcac-97d4-478b-b79a-54ba36afeb13 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.134776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8423bcac-97d4-478b-b79a-54ba36afeb13 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.160518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8423bcac-97d4-478b-b79a-54ba36afeb13 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Going to try to start instance {{(pid=127258) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:38:04.215683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8423bcac-97d4-478b-b79a-54ba36afeb13 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action" status: 202 len: 0 microversion: 2.1 time: 0.093256 Aug 24 03:38:04.216558 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 327/660] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:38:04 2022] POST /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:04.224771 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:04.225384 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:04.232557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.233070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.233487 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.234204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.234676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.235130 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.420885 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:04.432273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-bfb0ebc6-0b90-4792-83dc-4467e6fb5338 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1663 microversion: 2.1 time: 0.211287 Aug 24 03:38:04.433023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 334/661] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:04 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1663 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:04.617884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:04.618800 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:04.625623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.626113 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.626549 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.627302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.627759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.628212 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.838405 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:04.841141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:04.850516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a3100924-7fdc-4867-a654-b819ae4e5404 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1594 microversion: 2.1 time: 0.237805 Aug 24 03:38:04.851263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 328/662] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:04 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1594 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:05.460052 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:05.461306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:05.465164 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=68 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:05.473262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.473898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.474451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.475399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.475965 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.476491 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.482304 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:05.731033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.741327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f4ebb8e3-d193-46f7-b583-f1fdb457d19a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1663 microversion: 2.1 time: 0.286929 Aug 24 03:38:05.742264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 335/663] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:05 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1663 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:06.780472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:06.781499 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:06.794461 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.795374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.796418 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.797965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.798852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.799639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.143366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:07.158935 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-04d88bfa-ab8a-4b26-9111-d576d489bfae tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1663 microversion: 2.1 time: 0.386170 Aug 24 03:38:07.164958 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 329/664] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:06 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1663 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:07.915580 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-5c6b3f7c-6395-4f4a-b32b-84028a1508af req-be27dba0-26fb-4e6d-bfc5-a658966ed1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b212009b-b39e-44d4-901f-dae732632529", "tag": "8f793c88-f2e7-4c15-84bf-8bcd6407f687"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:07.936859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-5c6b3f7c-6395-4f4a-b32b-84028a1508af req-be27dba0-26fb-4e6d-bfc5-a658966ed1e1 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.938209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-5c6b3f7c-6395-4f4a-b32b-84028a1508af req-be27dba0-26fb-4e6d-bfc5-a658966ed1e1 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.939295 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-5c6b3f7c-6395-4f4a-b32b-84028a1508af req-be27dba0-26fb-4e6d-bfc5-a658966ed1e1 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.973413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-5c6b3f7c-6395-4f4a-b32b-84028a1508af req-be27dba0-26fb-4e6d-bfc5-a658966ed1e1 service nova] Creating event network-changed:8f793c88-f2e7-4c15-84bf-8bcd6407f687 for instance b212009b-b39e-44d4-901f-dae732632529 on hv-cinder-85426 Aug 24 03:38:07.995566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-5c6b3f7c-6395-4f4a-b32b-84028a1508af req-be27dba0-26fb-4e6d-bfc5-a658966ed1e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086518 Aug 24 03:38:07.996651 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 336/665] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:08.157374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.165404 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.166817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.167606 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.187679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.188703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:08.200342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.201116 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.201764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.202004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.202968 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.203251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.203744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.204055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.204643 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.239197 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-84ca95f6-3bfc-4d79-8458-806dd2b54c67 req-ee577967-1e0b-4a19-aa54-91c448f14ea9 admin admin] 10.222.0.79 "DELETE /compute/v2.1/os-assisted-volume-snapshots/74734eae-20bc-4dbd-9a83-b7a7882d82b4?delete_info=%7B%22file_to_merge%22:%20%22volume-beab121c-c8e5-4f85-afaf-56675898a005.74734eae-20bc-4dbd-9a83-b7a7882d82b4.vhdx%22,%20%22volume_id%22:%20%22beab121c-c8e5-4f85-afaf-56675898a005%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.185703 Aug 24 03:38:08.240868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 330/666] 10.222.0.79 () {62 vars in 1800 bytes} [Wed Aug 24 03:38:08 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/74734eae-20bc-4dbd-9a83-b7a7882d82b4?delete_info=%7B%22file_to_merge%22:%20%22volume-beab121c-c8e5-4f85-afaf-56675898a005.74734eae-20bc-4dbd-9a83-b7a7882d82b4.vhdx%22,%20%22volume_id%22:%20%22beab121c-c8e5-4f85-afaf-56675898a005%22%7D => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:08.429515 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:08.443205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d2a96cce-2736-4084-999a-1a4630b215cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1663 microversion: 2.1 time: 0.260814 Aug 24 03:38:08.452823 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 337/667] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1663 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:09.471656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.472853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:09.485659 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.486762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.488841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.490631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.491538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.492929 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.708202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1379441741"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:09.709122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:09.710957 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=4 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:09.717809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.718321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.718793 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.719545 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.720039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.720473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.758213 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:09.768895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7aabaad2-6009-4f0e-b397-62ac2552cf2f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1667 microversion: 2.1 time: 0.306055 Aug 24 03:38:09.769604 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 331/668] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1667 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:09.890745 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.network.security_group_api [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Adding security group 93a94113-237d-4095-9488-abac51aa209b to port 8f793c88-f2e7-4c15-84bf-8bcd6407f687 Aug 24 03:38:10.363582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f5c18d92-a08f-413c-84a6-320ccf48d910 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/action" status: 202 len: 0 microversion: 2.1 time: 0.659158 Aug 24 03:38:10.364585 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 338/669] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:38:09 2022] POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:10.396342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:10.397943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:10.406760 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-7dfe682e-a001-4057-8c49-1588804065b7 req-98b266f8-05b0-4391-897c-1f93f4620d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b212009b-b39e-44d4-901f-dae732632529", "tag": "8f793c88-f2e7-4c15-84bf-8bcd6407f687"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:10.430421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.432107 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.434600 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.437964 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.439528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.440616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.444384 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7dfe682e-a001-4057-8c49-1588804065b7 req-98b266f8-05b0-4391-897c-1f93f4620d88 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.445249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7dfe682e-a001-4057-8c49-1588804065b7 req-98b266f8-05b0-4391-897c-1f93f4620d88 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.446037 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7dfe682e-a001-4057-8c49-1588804065b7 req-98b266f8-05b0-4391-897c-1f93f4620d88 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.494296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-7dfe682e-a001-4057-8c49-1588804065b7 req-98b266f8-05b0-4391-897c-1f93f4620d88 service nova] Creating event network-changed:8f793c88-f2e7-4c15-84bf-8bcd6407f687 for instance b212009b-b39e-44d4-901f-dae732632529 on hv-cinder-85426 Aug 24 03:38:10.507926 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-7dfe682e-a001-4057-8c49-1588804065b7 req-98b266f8-05b0-4391-897c-1f93f4620d88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137686 Aug 24 03:38:10.508891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 332/670] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:10.758370 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:10.778763 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ecda452c-351d-4ed5-87df-e518cdee410a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1641 microversion: 2.1 time: 0.405415 Aug 24 03:38:10.779371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 339/671] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:10 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1641 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:14.453046 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:14.457619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.458120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.458547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.468626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.469116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.469552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.485942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-0e6c1deb-fcb8-4d26-944b-ddade997079e req-d3fc5371-1fad-4b3a-afb2-37aa01add9c0 admin admin] 10.222.0.79 "DELETE /compute/v2.1/os-assisted-volume-snapshots/122bb74f-76e6-4ef1-8274-aa82f5f93a08?delete_info=%7B%22file_to_merge%22:%20%22volume-beab121c-c8e5-4f85-afaf-56675898a005.122bb74f-76e6-4ef1-8274-aa82f5f93a08.vhdx%22,%20%22volume_id%22:%20%22beab121c-c8e5-4f85-afaf-56675898a005%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.116259 Aug 24 03:38:14.486635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 333/672] 10.222.0.79 () {62 vars in 1800 bytes} [Wed Aug 24 03:38:14 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/122bb74f-76e6-4ef1-8274-aa82f5f93a08?delete_info=%7B%22file_to_merge%22:%20%22volume-beab121c-c8e5-4f85-afaf-56675898a005.122bb74f-76e6-4ef1-8274-aa82f5f93a08.vhdx%22,%20%22volume_id%22:%20%22beab121c-c8e5-4f85-afaf-56675898a005%22%7D => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:19.418459 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:19.419106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:19.426272 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.426943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.427541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.428452 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.428948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.429478 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.564621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lazy-loading 'services' on Instance uuid 6083e5a4-9007-400d-be65-91cc4ca5cbdd {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:19.669269 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-03fb0680-a83f-413e-b8f2-c1a5f7344365 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd/os-volume_attachments/beab121c-c8e5-4f85-afaf-56675898a005" status: 202 len: 0 microversion: 2.1 time: 0.255459 Aug 24 03:38:19.670019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 340/673] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:38:19 2022] DELETE /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd/os-volume_attachments/beab121c-c8e5-4f85-afaf-56675898a005 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:21.938157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:21.938811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:21.941644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=15 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:21.948100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:21.948796 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:21.949252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.950006 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:21.950473 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:21.950929 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.981995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Going to try to terminate instance {{(pid=127258) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:22.105376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f07d8954-eaea-42d4-9089-877048360116 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 204 len: 0 microversion: 2.1 time: 0.169841 Aug 24 03:38:22.107444 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 334/674] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:21 2022] DELETE /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:38:22.119799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:22.120717 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:22.133885 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.134776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.135676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.136953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.137805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.138575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.352206 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:22.361886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c7405477-cb7f-4484-8bc9-42805765e299 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1513 microversion: 2.1 time: 0.247217 Aug 24 03:38:22.362641 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 341/675] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:22 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:23.385953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:23.386764 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:23.393995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:23.394494 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:23.394991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:23.395739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:23.396225 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:23.396678 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:23.552964 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:23.563039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cc776e27-3f43-4ab4-8500-1d1be15c01e7 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1513 microversion: 2.1 time: 0.182035 Aug 24 03:38:23.563665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 335/676] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:23 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:24.598685 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:24.599292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:24.607257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.607756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.608195 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.608922 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.609377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.609802 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.781098 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:24.793130 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-422e90b4-4f95-47ab-9be1-0eac6aefcb36 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1513 microversion: 2.1 time: 0.198670 Aug 24 03:38:24.793962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 342/677] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:24 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:25.819273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:25.820141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:25.823962 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=6 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:25.831214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.831893 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.832455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.833309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.833872 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.834403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.993530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:26.003433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0e13f9fc-c43c-4173-a1a7-5003a2e48225 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1513 microversion: 2.1 time: 0.190452 Aug 24 03:38:26.004197 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 336/678] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:25 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:27.028367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:27.029027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:27.036462 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.037039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.037734 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.038752 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.039260 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.039702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.211953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:27.226708 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-513becda-7510-48fd-9d3d-decb81742fb0 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1513 microversion: 2.1 time: 0.202739 Aug 24 03:38:27.227735 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 343/679] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:27 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:28.265312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:28.266188 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:28.274909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:28.276423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:28.277118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.278265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:28.279028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:28.279613 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.457721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:28.471380 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-65fa3821-5b98-49c9-b7cf-f8cf180b0195 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1513 microversion: 2.1 time: 0.212029 Aug 24 03:38:28.471990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 337/680] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:28 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:29.403571 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-210aa570-9991-4369-93e3-cbb08f214287 req-7cf34876-b71e-4d50-acef-a97e7e4b5b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6083e5a4-9007-400d-be65-91cc4ca5cbdd", "name": "network-vif-deleted", "tag": "bbb119e3-75ba-4591-bcb8-4c4696521c7b"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:29.414220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-210aa570-9991-4369-93e3-cbb08f214287 req-7cf34876-b71e-4d50-acef-a97e7e4b5b45 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.414753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-210aa570-9991-4369-93e3-cbb08f214287 req-7cf34876-b71e-4d50-acef-a97e7e4b5b45 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.415237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-210aa570-9991-4369-93e3-cbb08f214287 req-7cf34876-b71e-4d50-acef-a97e7e4b5b45 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.430050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-210aa570-9991-4369-93e3-cbb08f214287 req-7cf34876-b71e-4d50-acef-a97e7e4b5b45 service nova] Creating event network-vif-deleted:bbb119e3-75ba-4591-bcb8-4c4696521c7b for instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd on hv-cinder-85426 Aug 24 03:38:29.438930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-210aa570-9991-4369-93e3-cbb08f214287 req-7cf34876-b71e-4d50-acef-a97e7e4b5b45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119531 Aug 24 03:38:29.439986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 344/681] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:29.499644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.500512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.507703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.508194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.508630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.509348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.510201 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.511257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.554554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.555020 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.555457 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.555919 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lazy-loading 'fault' on Instance uuid 6083e5a4-9007-400d-be65-91cc4ca5cbdd {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:29.606299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b985a376cdbd45bf80a3142ffbd81fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727bfec133af4b0db4dd397ee32fbb2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:29.616539 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3a070ae9-ba5e-4650-98e5-46b3c2c67e0d tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 200 len: 1309 microversion: 2.1 time: 0.123315 Aug 24 03:38:29.617324 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 338/682] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:29 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:30.642081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:30.643038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] [instance: 6083e5a4-9007-400d-be65-91cc4ca5cbdd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:30.651438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.651939 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.652399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.653097 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.653567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.653991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.671311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] HTTP exception thrown: Instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd could not be found. Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Request method failure captured: Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd HTTP/1.1 Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZxT3lJp43eMrA4HAMrqrCT8bkYBJNbDrHtyTzRGoScnpvEwn9V-hHCBuX1ZmYC85VDk11sFvDz_JiSBmmqoR4H7DkgpHsPZMu_Un0slPxZzPUbENnBhKqzqi6qIgiLNDPjw2cq_gPFoFbu68DrC-gCAw5OV7-ZfA6ssSSpEYzzkx3k Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 727bfec133af4b0db4dd397ee32fbb2e Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesSnapshotTestJSON-118155070 Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:38:30.673044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/727bfec133af4b0db4dd397ee32fbb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/727bfec133af4b0db4dd397ee32fbb2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/727bfec133af4b0db4dd397ee32fbb2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_727bfec133af4b0db4dd397ee32fbb2e"}]}] Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesSnapshotTestJSON-118155070 Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 727bfec133af4b0db4dd397ee32fbb2e Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-118155070 Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesSnapshotTestJSON-118155070-project Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: b985a376cdbd45bf80a3142ffbd81fba Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesSnapshotTestJSON-118155070-project Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd could not be found. Aug 24 03:38:30.675489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '6083e5a4-9007-400d-be65-91cc4ca5cbdd'} Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd could not be found. Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:30.676914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd could not be found. Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd could not be found. Aug 24 03:38:30.679071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:30.681601 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] Returning 404 to user: Instance 6083e5a4-9007-400d-be65-91cc4ca5cbdd could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:30.681601 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2391dfae-ccbe-4418-a367-cb106b8ca994 tempest-VolumesSnapshotTestJSON-118155070 tempest-VolumesSnapshotTestJSON-118155070-project] 10.222.0.78 "GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd" status: 404 len: 111 microversion: 2.1 time: 0.038522 Aug 24 03:38:30.681601 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 345/683] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:30 2022] GET /compute/v2.1/servers/6083e5a4-9007-400d-be65-91cc4ca5cbdd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:34.111065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:34.112718 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:34.123935 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.124719 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.125742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.126932 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.127721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.128661 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.172261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6171ef36-79ff-40bb-be32-2b43377ca72b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.252790 Aug 24 03:38:34.173238 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 339/684] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4/ips => generated 150 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:34.190349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d1d77aa-0e09-41ec-94cd-dee2be33ed75"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:34.193961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:34.203450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.204089 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.204709 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.205634 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.206196 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.206791 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.335388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Invalid volume: volume 6d1d77aa-0e09-41ec-94cd-dee2be33ed75 is already attached to instances: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: POST /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4/os-volume_attachments HTTP/1.1 Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 74 Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:38:34.337371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {"volumeAttachment": {"volumeId": "6d1d77aa-0e09-41ec-94cd-dee2be33ed75"}} Aug 24 03:38:34.340605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Invalid volume: volume 6d1d77aa-0e09-41ec-94cd-dee2be33ed75 is already attached to instances: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'server_id': '06ca164a-c24d-4225-89e6-d5718d7e88b4', 'body': {'volumeAttachment': {'volumeId': '6d1d77aa-0e09-41ec-94cd-dee2be33ed75'}}} Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6d1d77aa-0e09-41ec-94cd-dee2be33ed75 is already attached to instances: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:34.341558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6d1d77aa-0e09-41ec-94cd-dee2be33ed75 is already attached to instances: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:34.342986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6d1d77aa-0e09-41ec-94cd-dee2be33ed75 is already attached to instances: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 400 to user: Invalid volume: volume 6d1d77aa-0e09-41ec-94cd-dee2be33ed75 is already attached to instances: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d4269472-cf8a-4022-8556-776b55f9382c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154151 Aug 24 03:38:34.344944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 346/685] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:38:34 2022] POST /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:38:34.364616 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:34.370898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:34.385084 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.385884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.386526 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.387844 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.388487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.389777 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.434369 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Going to try to terminate instance {{(pid=127258) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:34.557283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-92f081ef-18d7-4560-9ba5-05de609c6415 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 204 len: 0 microversion: 2.1 time: 0.208341 Aug 24 03:38:34.557982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 340/686] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:34 2022] DELETE /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:34.571869 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:34.573277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:34.580976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.581474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.581915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.582635 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.583150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.583556 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.750300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.758891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0dcebef4-8e84-462b-89be-ab1f2bc7c3cd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1681 microversion: 2.1 time: 0.195206 Aug 24 03:38:34.759818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 347/687] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:34 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:35.786779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:35.787520 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:35.795184 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.795676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.796209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.796987 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.797445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.797870 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.974818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:35.989202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f051e615-07f9-4a7c-a5d5-5dc049ba89a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1681 microversion: 2.1 time: 0.207084 Aug 24 03:38:35.990246 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 341/688] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:35 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:37.025275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:37.026049 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:37.029303 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=26 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:37.035404 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.035898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.036329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.037042 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.037488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.037909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.042596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:37.242182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.255483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-55cb42cc-7cac-4b82-96f9-5a00115b8fee tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1681 microversion: 2.1 time: 0.234119 Aug 24 03:38:37.256524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 348/689] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:37 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:38.283095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:38.283912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:38.292862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.293360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.293786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.294612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.295248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.295607 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.301080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:38.403978 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:38.421281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f7e713bc-221d-4af9-84a1-ef8962f0b1a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 200 len: 1613 microversion: 2.1 time: 0.143831 Aug 24 03:38:38.422200 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 342/690] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:38 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:38.453710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-c5f79045-9149-4145-afdc-f0983f83a43a req-3e80b1be-be17-40aa-9e21-fb1d59512f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ca164a-c24d-4225-89e6-d5718d7e88b4", "name": "network-vif-deleted", "tag": "03bb3254-a50d-4f10-bd77-86c1367ae692"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:38.467620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c5f79045-9149-4145-afdc-f0983f83a43a req-3e80b1be-be17-40aa-9e21-fb1d59512f40 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.468204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c5f79045-9149-4145-afdc-f0983f83a43a req-3e80b1be-be17-40aa-9e21-fb1d59512f40 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.468567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c5f79045-9149-4145-afdc-f0983f83a43a req-3e80b1be-be17-40aa-9e21-fb1d59512f40 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.484474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-c5f79045-9149-4145-afdc-f0983f83a43a req-3e80b1be-be17-40aa-9e21-fb1d59512f40 service nova] Creating event network-vif-deleted:03bb3254-a50d-4f10-bd77-86c1367ae692 for instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 on hv-cinder-85426 Aug 24 03:38:38.493966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-c5f79045-9149-4145-afdc-f0983f83a43a req-3e80b1be-be17-40aa-9e21-fb1d59512f40 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043918 Aug 24 03:38:38.495700 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 349/691] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:39.448607 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:39.449579 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:39.459906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.460802 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.461521 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.463393 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.464403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.464851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.491726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 HTTP/1.1 Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:38:39.495134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:38:39.497410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '06ca164a-c24d-4225-89e6-d5718d7e88b4'} Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:39.498595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:38:39.501353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:39.503640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:39.503640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e0bc8a64-4236-470c-8a22-ec9934e6185a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 404 len: 111 microversion: 2.1 time: 0.055876 Aug 24 03:38:39.503640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 343/692] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:39 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:39.511382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-93572001-c065-41b1-a431-794ab373d6f6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '.version_select at 0x7f4f440ca700>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:39.564642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-93572001-c065-41b1-a431-794ab373d6f6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-345673604" status: 202 len: 0 microversion: 2.1 time: 0.058959 Aug 24 03:38:39.566213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 350/693] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 24 03:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-345673604 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:40.872663 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:40.873514 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:40.888062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.889040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.889819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.891643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.895015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.896063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.082277 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lazy-loading 'services' on Instance uuid 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:41.192465 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-de7e0a32-07d8-489e-bf07-f490fa148985 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments/6d1d77aa-0e09-41ec-94cd-dee2be33ed75" status: 202 len: 0 microversion: 2.1 time: 0.325440 Aug 24 03:38:41.198708 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 344/694] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:38:40 2022] DELETE /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments/6d1d77aa-0e09-41ec-94cd-dee2be33ed75 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:41.212075 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:41.217534 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:41.234092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.235051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.235860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.237208 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.238097 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.241763 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.297946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-67c7797f-09bf-4890-a9b1-509ecdb1a681 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095150 Aug 24 03:38:41.299065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 351/695] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:38:41 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:42.316093 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:42.320045 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:42.330343 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.331014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.331677 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.332519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.333251 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.334001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.372622 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c7969d4b-1a67-4322-bd8c-a2f0ca41c037 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063221 Aug 24 03:38:42.373238 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 345/696] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:38:42 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:42.704117 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6ad740e-77f3-4599-a3a6-ba887cce716b"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:42.708310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:42.721211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.722058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.722876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.724158 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.724959 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.725736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.137090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3e77c1de-5235-4b54-8181-aac1f8457339 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441472 Aug 24 03:38:43.137748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 352/697] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:38:42 2022] POST /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:43.390526 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:43.394603 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:43.406279 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.407192 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.407931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.409111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.409904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.410711 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.467407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a8553fa4-191f-4bc2-8090-f67d25fd5f3f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084804 Aug 24 03:38:43.468398 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 346/698] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:38:43 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:38:43.582718 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:43.583369 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:43.593786 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.594339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.594839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.595605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.596313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.596742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.632630 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:43.742949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3e7149bd-50d8-4826-8db0-0bceebe6a1d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 204 len: 0 microversion: 2.1 time: 0.166154 Aug 24 03:38:43.743922 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 353/699] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:43 2022] DELETE /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:43.761999 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:43.763192 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:43.774226 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.775214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.776019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.777336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.778187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.778994 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.997977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:44.009109 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e2892a24-6369-43b1-bdf6-b1b6934c1da0 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1681 microversion: 2.1 time: 0.258333 Aug 24 03:38:44.010700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 347/700] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:43 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:45.031943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:45.032679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:45.040365 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.040915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.041318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.042078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.042751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.043182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.235242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:45.244896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1b2e2e7e-da65-4480-bcc3-6619f3930e5a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1681 microversion: 2.1 time: 0.217698 Aug 24 03:38:45.245568 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 354/701] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:45 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:46.270758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:46.271955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:46.284591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.285494 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.286245 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.287565 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.288412 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.289247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.535900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:46.548457 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-20393036-e944-4a49-bb73-4ab6442076fc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1681 microversion: 2.1 time: 0.285236 Aug 24 03:38:46.549760 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 348/702] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:46 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:46.612900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:46.618001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:46.625787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.626325 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.626808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.627535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.627991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.628422 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.660263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lazy-loading 'flavor' on Instance uuid 89f097f4-3522-408a-b729-f895148b7fbb {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:46.917945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-19b4b230-0714-40ab-893f-f3b2b9d420f2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/action" status: 200 len: 32 microversion: 2.1 time: 0.311347 Aug 24 03:38:46.925457 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 355/703] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:38:46 2022] POST /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:38:46.944091 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:46.949085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:46.979235 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.982126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.983990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.985931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.987153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.993771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.175557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:47.186841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-875aade0-c537-4936-9c5a-45e38821f685 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.259175 Aug 24 03:38:47.187526 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 349/704] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:46 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:47.580261 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:47.581323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:47.588824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.589431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.589888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.590993 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.591817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.592301 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.673352 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:47.686508 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cc1298e2-22c8-4d5f-baf4-9406dba3db53 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 200 len: 1613 microversion: 2.1 time: 0.111200 Aug 24 03:38:47.701989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 356/705] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:47 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:47.908263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-3519cd30-5694-4c85-b320-9dca2967f2f0 req-cf32306a-4068-416c-bc99-e4463924fcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ee23ad-01a0-4e1a-bef2-7b0d4019fbda", "name": "network-vif-deleted", "tag": "e6d7b44d-dba1-4857-9a24-2d8268f49c17"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:47.923247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3519cd30-5694-4c85-b320-9dca2967f2f0 req-cf32306a-4068-416c-bc99-e4463924fcc0 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.924821 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3519cd30-5694-4c85-b320-9dca2967f2f0 req-cf32306a-4068-416c-bc99-e4463924fcc0 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.925583 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3519cd30-5694-4c85-b320-9dca2967f2f0 req-cf32306a-4068-416c-bc99-e4463924fcc0 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.948576 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-3519cd30-5694-4c85-b320-9dca2967f2f0 req-cf32306a-4068-416c-bc99-e4463924fcc0 service nova] Creating event network-vif-deleted:e6d7b44d-dba1-4857-9a24-2d8268f49c17 for instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda on hv-cinder-85426 Aug 24 03:38:47.964849 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-3519cd30-5694-4c85-b320-9dca2967f2f0 req-cf32306a-4068-416c-bc99-e4463924fcc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061090 Aug 24 03:38:47.966732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 350/706] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:48.217400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:48.219503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:48.238860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.239428 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.239908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.240844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.241445 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.242193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.446200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:48.459977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fb97c037-3036-49fa-8ade-699baebb4cd6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.250155 Aug 24 03:38:48.461668 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 357/707] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:48 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:48.716562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:48.722189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:48.741812 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.744643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.745594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.747232 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.748419 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.749442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.779865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda HTTP/1.1 Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:38:48.783362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:38:48.786085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '88ee23ad-01a0-4e1a-bef2-7b0d4019fbda'} Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:48.787502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:38:48.789727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:38:48.791957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:48.791957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9e593d42-8e05-4ef2-afec-0822ee1b056e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 404 len: 111 microversion: 2.1 time: 0.077359 Aug 24 03:38:48.791957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 351/708] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:48 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:38:48.799688 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ac013a2a-7e51-4056-95e5-bb4663633377 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '.version_select at 0x7f4f440f75e0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:48.827212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ac013a2a-7e51-4056-95e5-bb4663633377 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194878468" status: 202 len: 0 microversion: 2.1 time: 0.031974 Aug 24 03:38:48.827926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 358/709] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 24 03:38:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194878468 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:49.488554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:49.489635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:49.503248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.504498 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.505996 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.507709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.516835 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.517643 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.851384 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:49.866365 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-73d97b30-2b17-4e00-a7ab-f6311e933608 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.385067 Aug 24 03:38:49.874938 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 352/710] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:49 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:49.884624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4197ff5a-fff9-46c4-ad1d-e9ed8e691ddc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: .version_select at 0x7f4f441fb670>, body: {"keypair": {"name": "tempest-keypair-1983605798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qfVpDhLLd4h1Q0aZCDbpjt8iQqw29fYhsdU5LxNwa40j/eDYgoHZ0eCHJ07Yue073k+23ywVegah8UMHfeHSV3JEHxOnk12bUbMcKDOKJ8T1hAsD1AfUJSBxX4MboGg=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:49.906398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-4197ff5a-fff9-46c4-ad1d-e9ed8e691ddc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:49.911146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-4197ff5a-fff9-46c4-ad1d-e9ed8e691ddc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:49.937672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4197ff5a-fff9-46c4-ad1d-e9ed8e691ddc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058162 Aug 24 03:38:49.938343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 359/711] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:38:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:50.901863 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:50.904479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:50.919598 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.922909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.924031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.926076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.927425 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.928549 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.234262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:51.246450 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-99549197-55ab-4517-9382-186f8f9ad9d9 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.353704 Aug 24 03:38:51.247294 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 353/712] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:50 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:51.864888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1523878216", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f5f140-61b8-4d93-a685-1b439b420020"}], "security_groups": [{"name": "tempest-securitygroup--1083066501"}], "key_name": "tempest-keypair-1983605798", "user_data": "}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:52.023581 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] validate_networks() for [('f9f5f140-61b8-4d93-a685-1b439b420020', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:52.285104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.286281 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:52.291690 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:52.301312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.302182 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.302985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.304451 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.305071 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.305886 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.979819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:53.004016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ab9ce52d-f41b-4a8a-ab0a-67989d0f94d4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.725951 Aug 24 03:38:53.006577 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 354/713] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:53.235698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:53.236731 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:53.237847 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:53.238503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:53.239711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:53.256302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.257214 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.257997 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.259757 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.260535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.261197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.292186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:53.299512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:53.318925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:53.321628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:53.389976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4b70ad1b-e500-4b0e-83a4-141b9a3761f2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.530658 Aug 24 03:38:53.401287 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 360/714] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:38:53.417706 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3290a7ef-7fba-489a-a7b8-a2105803f3db tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:53.418913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3290a7ef-7fba-489a-a7b8-a2105803f3db tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:53.520689 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3290a7ef-7fba-489a-a7b8-a2105803f3db tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:53.535379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3290a7ef-7fba-489a-a7b8-a2105803f3db tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1242 microversion: 2.1 time: 0.129336 Aug 24 03:38:53.536555 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 355/715] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:53 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:54.049934 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.052593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:54.070344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.071599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.073898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.075491 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.076519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.077330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.341144 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:54.358713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-49fc6e38-565c-489c-a416-2f672675450d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.317662 Aug 24 03:38:54.359888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 361/716] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:54 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:54.569536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.570452 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:54.582206 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.583551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.584460 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.586170 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.587074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.587866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.711367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:54.728606 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-df143952-1715-4900-bd27-0230ab14efba tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1238 microversion: 2.1 time: 0.163471 Aug 24 03:38:54.729634 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 356/717] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:54 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1238 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:55.399111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:55.400113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:55.413386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.414333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.415978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.417459 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.418318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.419237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.669369 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:55.685733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a4eae005-3610-4af3-89b1-2958efec07f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.293350 Aug 24 03:38:55.686925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 362/718] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:55 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:55.765654 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:55.767916 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:55.779102 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.779952 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.780667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.781934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.782830 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.783539 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.882912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:55.898180 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-330fdda5-6b89-4f01-a190-dcc107b8eb50 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1300 microversion: 2.1 time: 0.139340 Aug 24 03:38:55.899382 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 357/719] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:55 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:56.718832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:56.719955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.732806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.734028 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.735123 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.736420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.737254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.738044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.937866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:56.941261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.955293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.956470 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.957388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.958510 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.959567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.960446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.008326 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.025637 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e1bbc885-c1a0-4d9d-b81c-6fd32cdb117f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.314191 Aug 24 03:38:57.026640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 363/720] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:56 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:57.202819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.216498 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-94ce97fc-794a-4245-9663-ff6a625a3004 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.286376 Aug 24 03:38:57.217557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 358/721] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:56 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:57.723201 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-a6fabd08-a95c-49a3-b3ec-48af62319429 req-2f0038af-f9db-452b-96e1-0968be0bc7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c745a230-ab54-4a5f-8a4d-d5a785f3c59a", "tag": "7eb8ce42-ca79-4063-ae5f-34844ff69af9"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:57.750128 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a6fabd08-a95c-49a3-b3ec-48af62319429 req-2f0038af-f9db-452b-96e1-0968be0bc7cf service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.751043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a6fabd08-a95c-49a3-b3ec-48af62319429 req-2f0038af-f9db-452b-96e1-0968be0bc7cf service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.751798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a6fabd08-a95c-49a3-b3ec-48af62319429 req-2f0038af-f9db-452b-96e1-0968be0bc7cf service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.759332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:57.773864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-a6fabd08-a95c-49a3-b3ec-48af62319429 req-2f0038af-f9db-452b-96e1-0968be0bc7cf service nova] Creating event network-changed:7eb8ce42-ca79-4063-ae5f-34844ff69af9 for instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a on hv-cinder-85426 Aug 24 03:38:57.782116 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-a6fabd08-a95c-49a3-b3ec-48af62319429 req-2f0038af-f9db-452b-96e1-0968be0bc7cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065247 Aug 24 03:38:57.783215 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 364/722] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:58.064035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.065192 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:58.078547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.079512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.080350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.081899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.082810 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.083565 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.259554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.261379 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:58.271834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.272552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.273227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.274419 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.275398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.276094 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.291099 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:58.308676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fb1352a5-8c18-47fb-8ace-7312e14f2921 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.252676 Aug 24 03:38:58.309733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 359/723] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:58.555048 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:58.569535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b4cd8d63-8e5f-40e5-88a9-6a8ebb7114c5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.321687 Aug 24 03:38:58.570509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 365/724] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:59.351765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:59.352756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:59.363739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.364503 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.365187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.366287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.367033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.367703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.606353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:59.608100 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:59.618379 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.619171 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.620670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.620975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.621665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.622343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.645696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:59.661900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0e8b9681-ac66-40b9-be11-3a9dfbbbfa57 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.320138 Aug 24 03:38:59.663194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 360/725] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:59 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:59.880640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:59.894137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1fa44c1d-0c91-4f16-af1b-9e5557902d20 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.294338 Aug 24 03:38:59.895084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 366/726] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:59 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:00.700379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:00.701348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:00.714512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.715293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.715952 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.717083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.717782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.718428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.726106 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:00.928834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:00.930033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:00.943616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.944444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.945180 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.946453 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.947294 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.948056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.950597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:00.964106 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-21236958-bf9d-44e6-a58e-b0bac4712205 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.271294 Aug 24 03:39:00.965000 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 361/727] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:00 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:01.203719 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:01.218707 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-098a4780-a3d5-435d-874a-0b9024de5f1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.296953 Aug 24 03:39:01.219781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 367/728] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:00 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:01.997483 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:01.998552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.009434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.010332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.011059 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.012181 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.012887 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.013537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.257599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:02.259113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.259287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:02.271498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.272387 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.273465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.274548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4f868637-bf02-46e5-934c-20fa976b91bf tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.283318 Aug 24 03:39:02.274984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.276069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.277128 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.282522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 362/729] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:01 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:02.535548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:02.548747 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7edef611-9e4f-493b-bfa1-c4310254b177 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.299086 Aug 24 03:39:02.549649 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 368/730] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:02 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:03.308912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:03.309982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:03.321542 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.322360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.323067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.324183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.324932 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.325586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.529182 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:03.543166 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:03.552373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0faa2027-713a-4069-9e1e-1b908650d73a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.250214 Aug 24 03:39:03.553193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 363/731] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:03 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:03.578314 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:03.579428 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:03.582228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:03.583162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=10 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:03.589606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.590188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.590980 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.594564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.594564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.594564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.773971 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:03.783434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-335bcfec-b025-4f93-9832-c498a8114c52 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.209393 Aug 24 03:39:03.784212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 369/732] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:03 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:04.577463 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:04.578153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:04.586355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.586875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.587334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.588981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.589433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.589759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.764636 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:04.777056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a89c18f6-1716-420b-a6a5-11870888f3a3 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1735 microversion: 2.1 time: 0.203622 Aug 24 03:39:04.777953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 364/733] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:04 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:04.808460 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:04.809223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:04.816099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.816622 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.817101 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.817848 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.818309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.818765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.024619 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:05.038300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-bced4b0a-eb94-4a7a-ad88-f2995be5e10f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.234014 Aug 24 03:39:05.039278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 370/734] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:04 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:05.156854 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-6752783a-8e95-4e78-a3f4-dc68e09598e5 req-6a51d6a3-dcc8-4063-a02c-23b0c42f7325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c745a230-ab54-4a5f-8a4d-d5a785f3c59a", "name": "network-vif-plugged", "status": "completed", "tag": "7eb8ce42-ca79-4063-ae5f-34844ff69af9"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:05.168190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6752783a-8e95-4e78-a3f4-dc68e09598e5 req-6a51d6a3-dcc8-4063-a02c-23b0c42f7325 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.168737 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6752783a-8e95-4e78-a3f4-dc68e09598e5 req-6a51d6a3-dcc8-4063-a02c-23b0c42f7325 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.169312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-6752783a-8e95-4e78-a3f4-dc68e09598e5 req-6a51d6a3-dcc8-4063-a02c-23b0c42f7325 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.182304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-6752783a-8e95-4e78-a3f4-dc68e09598e5 req-6a51d6a3-dcc8-4063-a02c-23b0c42f7325 service nova] Creating event network-vif-plugged:7eb8ce42-ca79-4063-ae5f-34844ff69af9 for instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a on hv-cinder-85426 Aug 24 03:39:05.188732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-6752783a-8e95-4e78-a3f4-dc68e09598e5 req-6a51d6a3-dcc8-4063-a02c-23b0c42f7325 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280460 Aug 24 03:39:05.189536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 365/735] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:39:05.804229 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:05.805408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:05.816504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.817422 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.817644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.818455 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.819338 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.820466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.979235 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:05.989539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-853454c2-4c53-491b-8dbb-cf2cd028818d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1715 microversion: 2.1 time: 0.192733 Aug 24 03:39:05.990216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 371/736] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:05 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1715 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.066211 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.067441 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.078606 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.079226 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.079804 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.080768 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.081357 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.082012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.146507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.147067 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.153768 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.154264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.154733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.155461 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.155923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.156402 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.255142 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] HTTP exception thrown: Cannot 'detach_volume' instance 89f097f4-3522-408a-b729-f895148b7fbb while it is in vm_state rescued Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Request method failure captured: Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments/b6ad740e-77f3-4599-a3a6-ba887cce716b HTTP/1.1 Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZxAowYte1TnzkDC8E2BasP9nMh2qq3z0g6gLyXb4nCQOnft_YpKkhFXsYfauzVNMVRH3PUGTE25tn_8om-ND_s8ozoAvNgNctUS5PPDyME0f3EMBA398lqiTmDKCBU6tAHG7rKiyW0my49b3YO0CTLY9nfzNjyfDim3bydBtSaqdU4 Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:39:06.256998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66a102abeb7f46a292a49d1f022190e7"}]}] Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: ae4f7f8855b5445d863a825ce921c982 Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:39:06.264418 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Cannot 'detach_volume' instance 89f097f4-3522-408a-b729-f895148b7fbb while it is in vm_state rescued Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'server_id': '89f097f4-3522-408a-b729-f895148b7fbb', 'id': 'b6ad740e-77f3-4599-a3a6-ba887cce716b'} Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89f097f4-3522-408a-b729-f895148b7fbb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:06.265808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 89f097f4-3522-408a-b729-f895148b7fbb while it is in vm_state rescued Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 89f097f4-3522-408a-b729-f895148b7fbb while it is in vm_state rescued Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:06.268211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Returning 409 to user: Cannot 'detach_volume' instance 89f097f4-3522-408a-b729-f895148b7fbb while it is in vm_state rescued {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:06.270005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0a7d8b81-3a46-4bf7-9a99-80ba307a2c77 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "DELETE /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments/b6ad740e-77f3-4599-a3a6-ba887cce716b" status: 409 len: 152 microversion: 2.1 time: 0.116321 Aug 24 03:39:06.270005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 372/737] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:39:06 2022] DELETE /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments/b6ad740e-77f3-4599-a3a6-ba887cce716b => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:39:06.272827 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:06.273506 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.281246 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.281743 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.282179 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.283002 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.283606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.284109 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.300224 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:06.314702 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1ede1aa2-2277-4928-bae9-610553a35b21 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.256573 Aug 24 03:39:06.315757 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 366/738] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.375934 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-579a4fcc-b278-46a3-9d5f-8686b6478a61 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "POST /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/action" status: 202 len: 0 microversion: 2.1 time: 0.110502 Aug 24 03:39:06.376688 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 373/739] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:39:06 2022] POST /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:39:06.389944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.391115 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.401679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.402558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.403382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.404571 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.405424 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.406165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.532873 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.533520 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.543736 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.544514 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.545185 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.546206 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.546817 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.547330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.594613 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-32dbc2f2-b51e-4cb0-8873-f60fffe29c4d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments/f95c34e2-4354-4011-8927-d1411d8f4859" status: 200 len: 194 microversion: 2.20 time: 0.227889 Aug 24 03:39:06.596032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 367/740] 10.222.0.78 () {60 vars in 1454 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments/f95c34e2-4354-4011-8927-d1411d8f4859 => generated 194 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:39:06.604509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:06.622475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-556f5cdd-d5c7-416c-a79c-0a662cfede58 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1723 microversion: 2.1 time: 0.239820 Aug 24 03:39:06.627278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 374/741] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:06.687233 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.688040 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.700367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.701253 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.702052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.703360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.704191 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.704927 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.809211 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lazy-loading 'services' on Instance uuid aaca649f-ad0a-4355-b741-7e46388c74cd {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:06.913703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0ecf9ee5-6867-40b7-a01b-b2eeb31114f5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments/f95c34e2-4354-4011-8927-d1411d8f4859" status: 202 len: 0 microversion: 2.20 time: 0.235907 Aug 24 03:39:06.914428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 368/742] 10.222.0.78 () {60 vars in 1457 bytes} [Wed Aug 24 03:39:06 2022] DELETE /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments/f95c34e2-4354-4011-8927-d1411d8f4859 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:06.927895 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.930793 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.938846 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.939339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.939776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.940530 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.941156 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.941614 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.976781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-76410869-91e2-45c7-a4d1-53f5c003753b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054199 Aug 24 03:39:06.977517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 375/743] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:39:07.349947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:07.350775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:07.358085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.358599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.359069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.359789 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.360219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.360672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.584210 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:07.600782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-32a8f9a1-d217-4e7a-b2ea-18760264f82e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1368 microversion: 2.1 time: 0.255299 Aug 24 03:39:07.608993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 369/744] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:07 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:07.652760 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:07.653949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:07.659077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:07.666273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.667212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.667709 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.668624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.669152 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.669717 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.859277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:07.870826 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dd1cc9c9-f54a-4389-914e-78660ccf1dde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1723 microversion: 2.1 time: 0.225768 Aug 24 03:39:07.871630 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 376/745] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:07 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:07.990847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:07.994340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.002105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.002692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.003406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.004219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.004845 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.005383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.042018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9150c895-6712-4f8d-94e7-9de8d3233642 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055256 Aug 24 03:39:08.042617 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 370/746] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 24 03:39:07 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:39:08.638676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:08.639486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.647259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.648013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.648497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.650161 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.650739 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.651222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.839098 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:08.847946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1ac2ab6b-5cb1-4a0c-a7ac-d5a24cdf6f18 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1558 microversion: 2.1 time: 0.214502 Aug 24 03:39:08.848560 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 377/747] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:08 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:08.871536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:08.872327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.880120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.880644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.881106 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.882536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.882536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.883139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.901862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:08.903311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.916344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.917328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.918117 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.919482 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.920297 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.921005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.997566 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f1876678-4233-41f5-ad83-a516d5625768 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131464 Aug 24 03:39:08.999609 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 371/748] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:39:08 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:39:09.057608 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:09.061044 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:09.068242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.068755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.069216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.069956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.070417 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.071242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.108402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8c5b3a29-422b-41a0-9dd9-221577bd0e81 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055483 Aug 24 03:39:09.108872 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 372/749] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 24 03:39:09 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:39:09.290343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:09.319552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-eabc6e97-8507-4397-a264-5ad1b49a0dc2 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1723 microversion: 2.1 time: 0.424871 Aug 24 03:39:09.320264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 378/750] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:08 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:10.126100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.129940 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.141478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.142411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.143122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.144375 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.145135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.145854 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.203775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bde65b76-625e-43e6-a742-a7a2b25b6c23 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.084583 Aug 24 03:39:10.204575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 373/751] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:10.307398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.308627 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.320268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.321427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.322211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.323141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.323665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.324159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.358500 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.359342 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.360622 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:10.368883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.369825 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.370989 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.372380 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.373468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.374445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.392064 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:10.466742 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e4c3e04e-4bdf-4ccb-afe1-790b76698512 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 204 len: 0 microversion: 2.20 time: 0.166597 Aug 24 03:39:10.468312 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 379/752] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 24 03:39:10 2022] DELETE /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:39:10.478027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.479187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.485871 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.486366 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.486840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.487578 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.488046 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.488466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.637536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.654333 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7620b74c-4659-4d97-8f9c-3b2e4a97f12c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1723 microversion: 2.1 time: 0.299673 Aug 24 03:39:10.669282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 374/753] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:10.715634 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.728905 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-97d6e94f-1ea9-456e-8c95-bdd618715ee5 req-a93091d3-5808-4a96-b42a-ada4fdfbefed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c745a230-ab54-4a5f-8a4d-d5a785f3c59a", "tag": "7eb8ce42-ca79-4063-ae5f-34844ff69af9"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:10.731140 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.733822 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.735991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7f9f53a5-704c-41f7-b549-836ba6b03821 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.262108 Aug 24 03:39:10.738856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 380/754] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:10.741188 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-97d6e94f-1ea9-456e-8c95-bdd618715ee5 req-a93091d3-5808-4a96-b42a-ada4fdfbefed service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.741677 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-97d6e94f-1ea9-456e-8c95-bdd618715ee5 req-a93091d3-5808-4a96-b42a-ada4fdfbefed service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.742109 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-97d6e94f-1ea9-456e-8c95-bdd618715ee5 req-a93091d3-5808-4a96-b42a-ada4fdfbefed service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.755860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-97d6e94f-1ea9-456e-8c95-bdd618715ee5 req-a93091d3-5808-4a96-b42a-ada4fdfbefed service nova] Creating event network-changed:7eb8ce42-ca79-4063-ae5f-34844ff69af9 for instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a on hv-cinder-85426 Aug 24 03:39:10.761390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-97d6e94f-1ea9-456e-8c95-bdd618715ee5 req-a93091d3-5808-4a96-b42a-ada4fdfbefed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104344 Aug 24 03:39:10.762244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 375/755] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:11.678124 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:11.679177 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:11.688699 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.689393 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.690066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.691316 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.691940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.692560 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.769122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:11.770029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:11.778307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.778857 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.779302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.780026 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.780697 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.781124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.031384 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:12.041300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-49899826-02e6-4aba-821c-f66e132506ed tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1723 microversion: 2.1 time: 0.367548 Aug 24 03:39:12.041899 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 381/756] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:11 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:12.070405 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:12.081463 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:12.083273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:12.084596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-38100938-c2f0-46e0-b5c4-6fcc217a4714 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.320394 Aug 24 03:39:12.085409 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 376/757] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:11 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:13.068724 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:13.069490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:13.078063 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.078564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.079046 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.079855 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.080342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.080834 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.109679 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:13.110542 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:13.118596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.119213 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.119765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.120590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.121165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.121808 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.323597 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.333644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-bd613abf-3a92-401f-88df-46a361e07d8c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1723 microversion: 2.1 time: 0.269929 Aug 24 03:39:13.334253 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 382/758] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:13 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:13.341484 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.352677 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.354296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.355553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f3bc4026-033a-4933-b24f-4ae47033b441 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.250574 Aug 24 03:39:13.356270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 377/759] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:13 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:14.358129 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:14.359148 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:14.367750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.368306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.368811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.369593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.370107 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.370592 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.380480 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:14.381227 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:14.389767 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.390365 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.391068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.392157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.392807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.393313 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.623521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.635647 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.638736 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:14.639058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-04fbf4af-741c-4d3c-80a0-9a29c87c1d8d tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1729 microversion: 2.1 time: 0.284952 Aug 24 03:39:14.639919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 383/760] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:14 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1729 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:14.648226 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.650555 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.651920 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6d5eab88-df9e-4e32-a4e3-2af619ba433e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.275505 Aug 24 03:39:14.652712 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 378/761] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:14 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:14.671632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:14.672434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:14.683801 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.684671 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.685454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.686881 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.687719 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.688486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.983879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-272cd75f-528f-4329-addb-8509b6638f65 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.318946 Aug 24 03:39:14.984676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 384/762] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:39:14 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-interface => generated 285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:15.687015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:15.688215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:15.704368 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.705132 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.705938 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.707257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.708108 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.708912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.976706 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:15.993085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:15.996404 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:15.998577 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-127695b0-1592-4782-9ce9-a3d536182509 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.320527 Aug 24 03:39:15.999686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 379/763] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:15 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:17.037249 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:17.038329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:17.047165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:17.048692 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:17.049301 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:17.050235 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:17.051016 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:17.051575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:17.230048 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:17.244753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:17.247839 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:17.250055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e4b9e350-bc22-4533-9c61-9c701b8e8eb9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1724 microversion: 2.20 time: 0.217718 Aug 24 03:39:17.251038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 385/764] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:17 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:17.751462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-3044f7c9-5d39-4ada-8874-fecfc4ddf98a req-d25404b5-fbc4-4f24-af65-c72973fd7b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f097f4-3522-408a-b729-f895148b7fbb", "tag": "c6ee4054-246d-400d-a193-9ca2efe2b6d1"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:17.771648 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3044f7c9-5d39-4ada-8874-fecfc4ddf98a req-d25404b5-fbc4-4f24-af65-c72973fd7b64 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:17.773029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3044f7c9-5d39-4ada-8874-fecfc4ddf98a req-d25404b5-fbc4-4f24-af65-c72973fd7b64 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:17.775334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3044f7c9-5d39-4ada-8874-fecfc4ddf98a req-d25404b5-fbc4-4f24-af65-c72973fd7b64 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:17.813209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-3044f7c9-5d39-4ada-8874-fecfc4ddf98a req-d25404b5-fbc4-4f24-af65-c72973fd7b64 service nova] Creating event network-changed:c6ee4054-246d-400d-a193-9ca2efe2b6d1 for instance 89f097f4-3522-408a-b729-f895148b7fbb on hv-cinder-85426 Aug 24 03:39:17.824479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-3044f7c9-5d39-4ada-8874-fecfc4ddf98a req-d25404b5-fbc4-4f24-af65-c72973fd7b64 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082965 Aug 24 03:39:17.827123 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 380/765] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:18.288344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:18.289805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:18.304110 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.305212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.306146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.307182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.308649 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.309686 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.396460 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.397354 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.398374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.400823 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lazy-loading 'fault' on Instance uuid aaca649f-ad0a-4355-b741-7e46388c74cd {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:18.489204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:18.506988 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:18.513687 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:18.516997 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-055f1e5d-2f15-4feb-96b8-c674abfa523c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 200 len: 1371 microversion: 2.20 time: 0.235693 Aug 24 03:39:18.518465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 386/766] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:18 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:19.559180 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:19.561842 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:19.572603 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.573295 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.574059 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.575472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.576339 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.577119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.598554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] HTTP exception thrown: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Request method failure captured: Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd HTTP/1.1 Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvpx8_nChZ2GrTwo3_wmJm8TJ-pZPWlaJY7_lM48KMCb1XcoZbf4QN8UWkQpJ9bZqfvGfza7JZXKAG5OcMVjybxC8qink6GRAh8VVsyB90pOd4e-4dL4ZqozvBt3NS5Bdc6q8c_6rBQtjp2vOc4LciNwwJNRDdkifAunoESJArsqYM Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:39:19.600715 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70bebe773822488a90a1258551c3f09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70bebe773822488a90a1258551c3f09b"}]}] Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 45285b561f424fde9297724c6768250d Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:39:19.603723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'aaca649f-ad0a-4355-b741-7e46388c74cd'} Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:19.605249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:39:19.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.610220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Returning 404 to user: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:19.610220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-501d9ffb-c7cd-438f-8914-7029b7038e73 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 404 len: 111 microversion: 2.20 time: 0.053884 Aug 24 03:39:19.610220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 381/767] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:19 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:39:19.613120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0512c04b-27df-4ba7-a5fd-692c355a122a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '.version_select at 0x7f4f440f7c10>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:19.637155 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0512c04b-27df-4ba7-a5fd-692c355a122a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037068014" status: 204 len: 0 microversion: 2.20 time: 0.027807 Aug 24 03:39:19.637900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 387/768] 10.222.0.78 () {60 vars in 1262 bytes} [Wed Aug 24 03:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037068014 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:39:19.841041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-c548ab17-9a1a-4777-93af-a0b6d6f52c9b req-2359d96e-a315-4583-a271-38fce099f7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f097f4-3522-408a-b729-f895148b7fbb", "tag": "c6ee4054-246d-400d-a193-9ca2efe2b6d1"}, {"server_uuid": "aaca649f-ad0a-4355-b741-7e46388c74cd", "name": "network-vif-deleted", "tag": "f8a2d888-1c8d-4395-a171-9a83d1745a85"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:19.856675 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c548ab17-9a1a-4777-93af-a0b6d6f52c9b req-2359d96e-a315-4583-a271-38fce099f7fa service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.860442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c548ab17-9a1a-4777-93af-a0b6d6f52c9b req-2359d96e-a315-4583-a271-38fce099f7fa service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.861097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c548ab17-9a1a-4777-93af-a0b6d6f52c9b req-2359d96e-a315-4583-a271-38fce099f7fa service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.878833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-c548ab17-9a1a-4777-93af-a0b6d6f52c9b req-2359d96e-a315-4583-a271-38fce099f7fa service nova] Creating event network-changed:c6ee4054-246d-400d-a193-9ca2efe2b6d1 for instance 89f097f4-3522-408a-b729-f895148b7fbb on hv-cinder-85426 Aug 24 03:39:19.879334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-c548ab17-9a1a-4777-93af-a0b6d6f52c9b req-2359d96e-a315-4583-a271-38fce099f7fa service nova] Creating event network-vif-deleted:f8a2d888-1c8d-4395-a171-9a83d1745a85 for instance aaca649f-ad0a-4355-b741-7e46388c74cd on hv-cinder-85426 Aug 24 03:39:19.887060 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-c548ab17-9a1a-4777-93af-a0b6d6f52c9b req-2359d96e-a315-4583-a271-38fce099f7fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050103 Aug 24 03:39:19.887856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 382/769] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:20.796391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3051d316-2227-4da6-b3fb-fa94a2a0657a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'create', calling method: .version_select at 0x7f4f441e4940>, body: {"keypair": {"name": "tempest-keypair-1111701332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6TCn+0TCTCW8HmbjjzKMAvxJQUtjrWXnGEyD4X2z342DH9CqKAX0PyHZmZM1nJPiupG6mGVEjhpQB1nV3RJlgCt2CQxxdh4HJaQqFcWk+LtdMU05DB8ivxQoek/tqi9g=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:20.817611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-3051d316-2227-4da6-b3fb-fa94a2a0657a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for project 70bebe773822488a90a1258551c3f09b. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:20.824014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-3051d316-2227-4da6-b3fb-fa94a2a0657a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for user 45285b561f424fde9297724c6768250d and project 70bebe773822488a90a1258551c3f09b. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:20.858211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3051d316-2227-4da6-b3fb-fa94a2a0657a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.066533 Aug 24 03:39:20.858946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 388/770] 10.222.0.78 () {62 vars in 1200 bytes} [Wed Aug 24 03:39:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:39:22.568615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:39:22.569373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Wed Aug 24 03:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:39:22.858291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1458430274", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63d91dce-acd7-4f8a-97fb-8e912e624ee3"}], "security_groups": [{"name": "tempest-securitygroup--347837828"}], "key_name": "tempest-keypair-1111701332", "user_data": "}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:22.867331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=60 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:22.988294 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] validate_networks() for [('63d91dce-acd7-4f8a-97fb-8e912e624ee3', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:39:23.615447 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:39:23.615447 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:39:23.615447 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:39:23.618145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:39:23.618145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:39:23.634361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:23.634361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:23.634867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:23.635858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:23.636165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:23.636676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:23.661445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for project 70bebe773822488a90a1258551c3f09b. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:23.667602 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Getting quotas for user 45285b561f424fde9297724c6768250d and project 70bebe773822488a90a1258551c3f09b. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:23.683592 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:39:23.686623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:39:23.747052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR oslo.messaging._drivers.impl_rabbit [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [83708330-81e9-4c27-908d-17d691dc73b2] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:39:24.757016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [83708330-81e9-4c27-908d-17d691dc73b2] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46404. Aug 24 03:39:24.764165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-95855780-c4e6-4795-bef4-dc77caf7be18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.911877 Aug 24 03:39:24.765454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 383/771] 10.222.0.78 () {62 vars in 1188 bytes} [Wed Aug 24 03:39:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 03:39:24.780945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-17cd70e3-0cb3-47e6-83d5-779d937d14d8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:24.781931 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-17cd70e3-0cb3-47e6-83d5-779d937d14d8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:24.870459 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-17cd70e3-0cb3-47e6-83d5-779d937d14d8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:24.885005 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-17cd70e3-0cb3-47e6-83d5-779d937d14d8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:24.888026 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-17cd70e3-0cb3-47e6-83d5-779d937d14d8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:24.891251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-17cd70e3-0cb3-47e6-83d5-779d937d14d8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1282 microversion: 2.20 time: 0.116150 Aug 24 03:39:24.892226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 389/772] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:24 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:25.934982 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-aa77776e-2653-47fd-a9a7-3c8b54c4126d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:25.936125 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-aa77776e-2653-47fd-a9a7-3c8b54c4126d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:26.017913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-aa77776e-2653-47fd-a9a7-3c8b54c4126d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:26.032558 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-aa77776e-2653-47fd-a9a7-3c8b54c4126d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:26.035021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-aa77776e-2653-47fd-a9a7-3c8b54c4126d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:26.036916 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-aa77776e-2653-47fd-a9a7-3c8b54c4126d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1282 microversion: 2.20 time: 0.110201 Aug 24 03:39:26.037732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 384/773] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:25 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:27.075976 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-387769b1-8744-4558-a856-f56019298f5f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:27.076867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-387769b1-8744-4558-a856-f56019298f5f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:27.146501 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-387769b1-8744-4558-a856-f56019298f5f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:27.155951 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-387769b1-8744-4558-a856-f56019298f5f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:27.157571 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-387769b1-8744-4558-a856-f56019298f5f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:27.158860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-387769b1-8744-4558-a856-f56019298f5f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1282 microversion: 2.20 time: 0.087153 Aug 24 03:39:27.159437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 390/774] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:27 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:28.203889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-08649c2a-cc28-4079-bcef-8fd4b9c85360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:28.205190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-08649c2a-cc28-4079-bcef-8fd4b9c85360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:28.317115 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-08649c2a-cc28-4079-bcef-8fd4b9c85360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:28.328448 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-08649c2a-cc28-4079-bcef-8fd4b9c85360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:28.332086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-08649c2a-cc28-4079-bcef-8fd4b9c85360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:28.334645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-08649c2a-cc28-4079-bcef-8fd4b9c85360 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1282 microversion: 2.20 time: 0.139946 Aug 24 03:39:28.335823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 385/775] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:28 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:29.360896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:29.362013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:29.365025 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:29.372973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.373793 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.374303 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.375127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.375634 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.376129 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.490187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:29.502393 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:29.504298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:29.506150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9e67f0f1-df20-46cb-8e17-3389aeed7fab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1286 microversion: 2.20 time: 0.150374 Aug 24 03:39:29.507665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 391/776] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:29 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:29.905309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:29.909863 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:29.922994 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.923865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.924645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.925997 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.926990 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.928019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.970094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4276a919-2f14-4154-afe8-ef112fa75337 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072641 Aug 24 03:39:29.970764 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 386/777] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:39:29 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:39:30.044096 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:30.044796 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:30.052344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.052965 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.053389 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.054368 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.055137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.055675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.085574 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:30.227938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9e5bc344-9707-4d0e-a441-a716d9432ab0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 204 len: 0 microversion: 2.1 time: 0.186443 Aug 24 03:39:30.228942 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 392/778] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:30 2022] DELETE /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:30.238207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:30.238864 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:30.245696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.246194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.246641 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.247423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.247891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.248321 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.407957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:30.417552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4977b67e-cb04-4a53-93b1-1890a94cf163 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1673 microversion: 2.1 time: 0.183237 Aug 24 03:39:30.418193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 387/779] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:30 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:30.547035 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:30.547660 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:30.556203 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.556708 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.557138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.558253 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.558750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.559190 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.644074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:30.660446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:30.663481 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:30.666039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c5d193b0-72b1-477e-b4fd-fffd514d423a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1342 microversion: 2.20 time: 0.123615 Aug 24 03:39:30.667115 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 393/780] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:30 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1342 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:31.441382 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:31.442308 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:31.455942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.457085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.457705 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.458687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.459296 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.460001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.682802 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.698894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:31.700496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0a4dea42-a744-47be-93fc-4cb673e8d7f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1673 microversion: 2.1 time: 0.262948 Aug 24 03:39:31.701634 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 388/781] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:31 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1673 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:31.702741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:31.718283 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.720985 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.722794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.724559 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.726750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.728399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.823972 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.834779 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.836189 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.837513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4b3fcd4c-5d74-46c6-b051-6d87da632ac6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1340 microversion: 2.20 time: 0.146965 Aug 24 03:39:31.838222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 394/782] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:31 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1340 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:32.737930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.738794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.747469 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.747986 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.748527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.750346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.750346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.751016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.877527 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.879800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.892770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.893643 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.894468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.896093 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.896960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.898566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.985860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:32.998586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-43d50240-19e3-4b5e-aa11-08bdb28d0e3d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1673 microversion: 2.1 time: 0.265027 Aug 24 03:39:32.999777 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 389/783] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:33.007495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.026427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.029140 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.030856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-03d1128c-786e-4f8d-bd67-ecae71afe03d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1340 microversion: 2.20 time: 0.160833 Aug 24 03:39:33.031730 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 395/784] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1340 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:34.042579 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:34.043957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:34.048570 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:34.065378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.065800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:34.066581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.066790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.068028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.068340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:34.069123 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.069818 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.090239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.091562 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.092320 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.093867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.096310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.097414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.365088 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:34.382381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-811e07a5-df0f-4df4-a3c0-6657d2f4ffc1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1673 microversion: 2.1 time: 0.347684 Aug 24 03:39:34.383434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 390/785] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:34 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1673 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:34.406830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:34.425104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:34.428613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:34.431777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-81dc6fb8-a112-4a6b-a562-58e1c6ff8bd5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.379875 Aug 24 03:39:34.433613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 396/786] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:34 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:35.211192 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-c21030bf-ef00-4e51-9b60-96888251ecff req-90fd4d2c-ca45-4b7f-9723-ad4a775fd99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d705a9b-3c26-4e94-b89e-a23a4c38320d", "name": "network-vif-deleted", "tag": "2f066fe2-d5fc-4112-8e50-0029970924ff"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:35.232242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c21030bf-ef00-4e51-9b60-96888251ecff req-90fd4d2c-ca45-4b7f-9723-ad4a775fd99d service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.233050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c21030bf-ef00-4e51-9b60-96888251ecff req-90fd4d2c-ca45-4b7f-9723-ad4a775fd99d service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.233855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c21030bf-ef00-4e51-9b60-96888251ecff req-90fd4d2c-ca45-4b7f-9723-ad4a775fd99d service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.261733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-c21030bf-ef00-4e51-9b60-96888251ecff req-90fd4d2c-ca45-4b7f-9723-ad4a775fd99d service nova] Creating event network-vif-deleted:2f066fe2-d5fc-4112-8e50-0029970924ff for instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d on hv-cinder-85426 Aug 24 03:39:35.272478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-c21030bf-ef00-4e51-9b60-96888251ecff req-90fd4d2c-ca45-4b7f-9723-ad4a775fd99d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069555 Aug 24 03:39:35.274493 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 391/787] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:35.416680 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:35.419207 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:35.436423 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.437274 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.438066 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.439412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.440289 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.441150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.476921 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:35.478326 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:35.485946 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.486924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.487617 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.488696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.490047 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.490796 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.513505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.514408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.517903 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.519243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lazy-loading 'fault' on Instance uuid 6d705a9b-3c26-4e94-b89e-a23a4c38320d {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:35.614060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:35.626126 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-26b572ac-7473-4098-802b-23e04dc2289d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 200 len: 1328 microversion: 2.1 time: 0.222936 Aug 24 03:39:35.626777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 397/788] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:35 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 1328 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:35.747843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:35.763832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:35.767952 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:35.770482 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4c823c44-26b5-4c07-a0d0-879ec031fda3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.300113 Aug 24 03:39:35.783102 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 392/789] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:35 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:36.455408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:36.458473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.468229 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.469165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.469900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.471333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.472765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.473840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.592180 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9192c938-ad04-4fb5-af29-b187a7df70ee tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/action" status: 202 len: 0 microversion: 2.1 time: 0.141731 Aug 24 03:39:36.593439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 398/790] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:39:36 2022] POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:39:36.602327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.603148 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.610282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.610840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.611298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.612065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.612547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.612985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.671996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.673118 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.682950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.683658 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.684221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.685219 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.685814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.686339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.720554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] HTTP exception thrown: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Request method failure captured: Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d HTTP/1.1 Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvgPX48w3Bm_JwaJ76DGuY8nAA3ihKvc65ySDtS4dNxUKI7TfztAznIZpjUOzqGugLDEMIa8-Vom-C1ZJq4yuYfhinWnqIpuixTaKivePyAy2vAOyug6ELa8HDnIrs3MDWrjIB0tfcDwEVoz9eRem-Ttd-GXL9xWkdKdKBWw0YJ6l8 Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:39:36.731185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8a745b184d3a462fae7c81ce668b01d2"}]}] Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 1507cffe84dc4849a7040333ad48d99c Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:39:36.733200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '6d705a9b-3c26-4e94-b89e-a23a4c38320d'} Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:36.734408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:39:36.736192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:39:36.737763 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Returning 404 to user: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:36.739022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3ee32df1-5a3e-457c-820b-e9e634267743 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 404 len: 111 microversion: 2.1 time: 0.072720 Aug 24 03:39:36.740110 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 399/791] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:36.753513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9ea6783c-e0ca-467a-9a05-6fe17b9ead6f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '.version_select at 0x7f4f444ae280>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.787845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9ea6783c-e0ca-467a-9a05-6fe17b9ead6f tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367747453" status: 202 len: 0 microversion: 2.1 time: 0.041804 Aug 24 03:39:36.788923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 400/792] 10.222.0.78 () {58 vars in 1221 bytes} [Wed Aug 24 03:39:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367747453 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:36.816958 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.818747 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.822457 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:36.829395 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.830299 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.831135 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.833109 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.834021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.834837 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.837739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-152ddf72-3c9d-4cfa-83f1-9753ce7bd914 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1752 microversion: 2.1 time: 0.239412 Aug 24 03:39:36.839119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 393/793] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1752 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:37.030824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:37.049260 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:37.051261 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:37.053225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-112a904a-2b26-4785-ae27-383186d95311 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.244359 Aug 24 03:39:37.054884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 401/794] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:37.293432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-72bd4b3d-41d9-4e61-b8b0-f89e23984892 req-35d34630-413d-430e-be7d-83a0e77584ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be6880b5-1956-4d0a-b158-c65c6b7bd948", "tag": "07002f87-3795-4afe-ab6b-c223cea78539"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:37.306597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-72bd4b3d-41d9-4e61-b8b0-f89e23984892 req-35d34630-413d-430e-be7d-83a0e77584ee service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.307229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-72bd4b3d-41d9-4e61-b8b0-f89e23984892 req-35d34630-413d-430e-be7d-83a0e77584ee service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.308114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-72bd4b3d-41d9-4e61-b8b0-f89e23984892 req-35d34630-413d-430e-be7d-83a0e77584ee service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.322078 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-72bd4b3d-41d9-4e61-b8b0-f89e23984892 req-35d34630-413d-430e-be7d-83a0e77584ee service nova] Creating event network-changed:07002f87-3795-4afe-ab6b-c223cea78539 for instance be6880b5-1956-4d0a-b158-c65c6b7bd948 on hv-cinder-85426 Aug 24 03:39:37.328992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-72bd4b3d-41d9-4e61-b8b0-f89e23984892 req-35d34630-413d-430e-be7d-83a0e77584ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039728 Aug 24 03:39:37.330376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 394/795] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:37.629733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3a6c0c1e-1bf6-45d6-a28d-cbfb549c2072 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'create', calling method: .version_select at 0x7f4f441e4ca0>, body: {"keypair": {"name": "tempest-keypair-569144878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPv+3bVMucsqLU8fAyqaCqYMQjJ3CANK8XgypxbEGBACNWdbCMa5zAoOmkprBwMLaC7QZlcGTuE34o0KApXvI2iy6M2PN5Rh/FK8peiq1NcIG7o8T9zb9Xc5imQbdfh+jg=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:37.637266 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=8 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:37.653473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-3a6c0c1e-1bf6-45d6-a28d-cbfb549c2072 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:37.659723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-3a6c0c1e-1bf6-45d6-a28d-cbfb549c2072 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for user 1507cffe84dc4849a7040333ad48d99c and project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:37.694246 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3a6c0c1e-1bf6-45d6-a28d-cbfb549c2072 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068635 Aug 24 03:39:37.695598 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 402/796] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:39:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:37.887058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:37.889344 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:37.905487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.906811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.907438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.908389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.910138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.910138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.092011 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:38.093307 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:38.097106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:38.107251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.108055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.108684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.109474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.109941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.110379 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.264008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.280207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-aac86353-b673-4614-8332-ab9001b810b3 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1752 microversion: 2.1 time: 0.406695 Aug 24 03:39:38.281116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 395/797] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:37 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1752 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:38.371008 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.383897 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.386539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.388242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-577076b5-003e-4246-a4ce-f81bd9a1d57a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.305752 Aug 24 03:39:38.389112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 403/798] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:38 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:39.332815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:39.336070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:39.340252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=10 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:39.356656 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.357287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.358121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.359589 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.360647 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.361494 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.430318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:39.433311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:39.456216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.463595 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.464778 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.466431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.467785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.469144 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.684446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:39.697567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cb116d65-bed5-4224-b586-666e77db5ef7 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1752 microversion: 2.1 time: 0.375238 Aug 24 03:39:39.715199 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 396/799] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:39 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1752 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:39.723258 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:39.733964 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:39.749445 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:39.750689 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-db34da75-5cbe-4260-89cc-3915c069adde tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.339246 Aug 24 03:39:39.752078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 404/800] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:39 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:39.914264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-170279698", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d345d2d-fcdb-4acc-8902-c21c26cd29f1"}], "security_groups": [{"name": "tempest-securitygroup--58009752"}], "key_name": "tempest-keypair-569144878", "user_data": "}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:40.087005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] validate_networks() for [('9d345d2d-fcdb-4acc-8902-c21c26cd29f1', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:39:40.734533 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:39:40.735591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:39:40.736884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:39:40.736884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:39:40.737504 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:39:40.739710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:40.741993 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:40.754728 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.755081 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.755572 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.756218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.756406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.756989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.757571 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.759255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.759467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.760287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.760866 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.761878 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.812771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:40.820204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Getting quotas for user 1507cffe84dc4849a7040333ad48d99c and project 8a745b184d3a462fae7c81ce668b01d2. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:40.839370 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:39:40.842043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:39:40.916832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9b3e6731-6af4-4bdf-b6e3-2704ac549a59 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.011569 Aug 24 03:39:40.928942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 397/801] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:39:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:39:40.928942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:40.928942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:40.949104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.955272 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.955877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.956730 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.957289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.957805 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:41.219105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.234425 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-35f980b5-3f03-4741-ba3c-5885c27f590a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1752 microversion: 2.1 time: 0.504616 Aug 24 03:39:41.255344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 405/802] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:40 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1752 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:41.269665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ff6814dc-cce7-4f8b-ae15-f177a41e6981 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:41.270726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ff6814dc-cce7-4f8b-ae15-f177a41e6981 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:41.350112 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.371211 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.376151 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.380177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-027059d6-3575-4b21-b634-12c6fe169a3b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.458190 Aug 24 03:39:41.381673 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 398/803] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:40 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:41.458211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ff6814dc-cce7-4f8b-ae15-f177a41e6981 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.464810 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ff6814dc-cce7-4f8b-ae15-f177a41e6981 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1236 microversion: 2.1 time: 0.207659 Aug 24 03:39:41.465633 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 406/804] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:41 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1236 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:42.272134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.273332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.281966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.282568 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.283135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.283979 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.284504 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.285020 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.423773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.429163 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.445180 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.446197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.447065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.448428 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.449193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.450275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.541607 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:42.557702 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-98422e7c-9255-44f3-8afe-6be00db3becc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.289088 Aug 24 03:39:42.559299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 399/805] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:42 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:42.567498 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.569024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.579143 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.579667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.580123 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.580949 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.581371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.581913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.740122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:42.755578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-94604434-b031-4a0b-9bf1-872829647735 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1296 microversion: 2.1 time: 0.194457 Aug 24 03:39:42.757665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 400/806] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:42 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1296 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:42.783639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:42.795237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:42.796710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:42.797966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e6c5a0fa-241f-4a63-92d1-a2f1157e8e2f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.383887 Aug 24 03:39:42.798905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 407/807] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:42 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:43.427348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-2c4765c3-de5b-46d9-bfd9-25f0cb1f3160 req-4cbca828-8375-41d5-b875-b80caa3cee8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6880b5-1956-4d0a-b158-c65c6b7bd948", "name": "network-vif-plugged", "status": "completed", "tag": "07002f87-3795-4afe-ab6b-c223cea78539"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:43.445500 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2c4765c3-de5b-46d9-bfd9-25f0cb1f3160 req-4cbca828-8375-41d5-b875-b80caa3cee8f service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.446794 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2c4765c3-de5b-46d9-bfd9-25f0cb1f3160 req-4cbca828-8375-41d5-b875-b80caa3cee8f service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.447658 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2c4765c3-de5b-46d9-bfd9-25f0cb1f3160 req-4cbca828-8375-41d5-b875-b80caa3cee8f service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.470311 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-2c4765c3-de5b-46d9-bfd9-25f0cb1f3160 req-4cbca828-8375-41d5-b875-b80caa3cee8f service nova] Creating event network-vif-plugged:07002f87-3795-4afe-ab6b-c223cea78539 for instance be6880b5-1956-4d0a-b158-c65c6b7bd948 on hv-cinder-85426 Aug 24 03:39:43.480792 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-2c4765c3-de5b-46d9-bfd9-25f0cb1f3160 req-4cbca828-8375-41d5-b875-b80caa3cee8f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060639 Aug 24 03:39:43.482073 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 401/808] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:39:43.585386 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:43.597349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:43.607854 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.608700 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.609347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.610259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.610754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.611371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.616950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:43.794487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:43.795856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:43.814006 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.815492 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.815972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.816895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.817391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.817831 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.886818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:43.899825 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e79efd0c-86c3-45e2-a24b-7653385715ff tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.321387 Aug 24 03:39:43.907733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 408/809] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:43 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:43.927946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:43.932223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:43.946297 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.947888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.948664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.950012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.950941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.952036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.158048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:44.163588 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:44.179367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1cf07029-b5be-4802-88cc-505c2f5ae571 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.393361 Aug 24 03:39:44.181015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 402/810] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:43 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:44.205562 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:44.215662 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:44.217420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:44.218753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ce577312-d369-43a0-bbc4-0214591927bb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.309489 Aug 24 03:39:44.219412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 409/811] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:43 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:39:44.817831 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-4b79c6d8-6482-4a4b-9cd5-a899e747588b req-62f96685-3b35-47e0-a53c-6c2a497a15c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a3ce71-d62f-4c9c-9458-35eed0f2cad2", "tag": "dede27de-7357-424e-b33b-d2709f04ce10"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:44.830975 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4b79c6d8-6482-4a4b-9cd5-a899e747588b req-62f96685-3b35-47e0-a53c-6c2a497a15c3 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.831995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4b79c6d8-6482-4a4b-9cd5-a899e747588b req-62f96685-3b35-47e0-a53c-6c2a497a15c3 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.832668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4b79c6d8-6482-4a4b-9cd5-a899e747588b req-62f96685-3b35-47e0-a53c-6c2a497a15c3 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.847415 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-4b79c6d8-6482-4a4b-9cd5-a899e747588b req-62f96685-3b35-47e0-a53c-6c2a497a15c3 service nova] Creating event network-changed:dede27de-7357-424e-b33b-d2709f04ce10 for instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 on hv-cinder-85426 Aug 24 03:39:44.853726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-4b79c6d8-6482-4a4b-9cd5-a899e747588b req-62f96685-3b35-47e0-a53c-6c2a497a15c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041542 Aug 24 03:39:44.854586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 403/812] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:44.935488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:44.936158 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:44.943546 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.944034 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.944617 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.945328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.945778 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.946205 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.120140 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:45.130640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b010fb8b-7bf4-43bd-97c8-f114d2203d2c tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.199508 Aug 24 03:39:45.131310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 410/813] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:44 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:45.205668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:45.206422 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:45.214111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.214684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.215217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.216138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.216651 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.217347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.247654 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:45.248767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:45.256146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.256769 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.257362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.258204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.259311 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.260073 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.477891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:45.487309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-de49c11a-734d-4f2b-9703-f554e92b39cd tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.286023 Aug 24 03:39:45.488327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 404/814] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:45 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:45.511288 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:45.522148 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:45.524116 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:45.525394 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-416282df-1fed-4e42-9189-2bbc0f23c3ab tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1407 microversion: 2.20 time: 0.282393 Aug 24 03:39:45.526136 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 411/815] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:45 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:46.155069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.155960 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:46.164113 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.164850 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.165330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.166087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.166545 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.167762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.365640 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.376906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-e3f967be-4623-47b0-ae59-165b40036b88 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.226260 Aug 24 03:39:46.377525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 405/816] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:46 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:46.509821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.510573 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:46.518251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.518855 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.519358 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.520144 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.520730 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.521211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.565625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.566420 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:46.575383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.576134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.576741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.578294 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.579094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.579810 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.766874 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.782355 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b9ff97b2-e039-4b04-b354-34b6a3b7c0f4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.276121 Aug 24 03:39:46.783918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 412/817] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:46 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:46.816137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.831527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.833133 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.834407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0e2f1d74-3982-4216-9f3a-f6d984a9b370 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1599 microversion: 2.20 time: 0.273634 Aug 24 03:39:46.835075 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 406/818] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:39:46 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1599 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:39:46.868321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.868833 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:46.875611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.876119 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.876640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.877403 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.877870 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.878298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.994690 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1f604f46-1037-4685-a967-74899c7c1f5d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130499 Aug 24 03:39:46.995949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 413/819] 10.222.0.78 () {60 vars in 1316 bytes} [Wed Aug 24 03:39:46 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:39:47.404939 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:47.405856 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:47.414527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.415198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.415698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.416532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.417139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.417629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.619802 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:47.635483 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-79541aa9-c2e2-4164-9d88-e4c6c8fd696d tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.234912 Aug 24 03:39:47.637070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 407/820] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:47 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:47.811626 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:47.812573 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:47.819451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.819975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.820532 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.821273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.821751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.822178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.995484 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:48.004379 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4a87d022-dea4-4003-a54f-353a2672f32e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.197753 Aug 24 03:39:48.005342 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 414/821] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:47 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:48.579934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-c456b24b-12bd-4a6c-b8a2-c58dee69a546 req-d9411fd9-a122-449e-9730-c296ac81b008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be6880b5-1956-4d0a-b158-c65c6b7bd948", "tag": "07002f87-3795-4afe-ab6b-c223cea78539"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:48.595034 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c456b24b-12bd-4a6c-b8a2-c58dee69a546 req-d9411fd9-a122-449e-9730-c296ac81b008 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:48.595840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c456b24b-12bd-4a6c-b8a2-c58dee69a546 req-d9411fd9-a122-449e-9730-c296ac81b008 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:48.596583 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c456b24b-12bd-4a6c-b8a2-c58dee69a546 req-d9411fd9-a122-449e-9730-c296ac81b008 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:48.612035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-c456b24b-12bd-4a6c-b8a2-c58dee69a546 req-d9411fd9-a122-449e-9730-c296ac81b008 service nova] Creating event network-changed:07002f87-3795-4afe-ab6b-c223cea78539 for instance be6880b5-1956-4d0a-b158-c65c6b7bd948 on hv-cinder-85426 Aug 24 03:39:48.618527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-c456b24b-12bd-4a6c-b8a2-c58dee69a546 req-d9411fd9-a122-449e-9730-c296ac81b008 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042707 Aug 24 03:39:48.619241 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 408/822] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:39:48.675723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:48.676830 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:48.689165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:48.690030 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:48.690829 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:48.691954 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:48.692767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:48.693539 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:48.891221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:48.901357 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-017854f5-e382-40e8-8725-ae79c914f4b8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.232901 Aug 24 03:39:48.902284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 415/823] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:48 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:49.042295 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:49.043375 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:49.053188 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.053742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.054342 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.055119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.055612 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.056219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.241733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:49.255518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-56063d98-7129-4faf-845b-b5ac206cd2da tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.219225 Aug 24 03:39:49.256662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 409/824] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:49 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:49.924101 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:49.924928 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:49.933286 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.933898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.934466 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.935315 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.935818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.936284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.130033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:50.144128 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3fa50821-27bd-49dc-8773-bc6210c63b46 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.224224 Aug 24 03:39:50.144748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 416/825] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:49 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:50.288325 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:50.289154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:50.297346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.298038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.298625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.299565 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.300087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.300567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.460477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:50.470930 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9deeff36-c586-4f7d-b930-e0d04af95d9a tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.186863 Aug 24 03:39:50.471630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 410/826] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:50 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:51.167998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:51.168754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:51.176349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.176958 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.177478 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.178333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.179776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.180276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.372840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:51.382159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fd29ed39-ce0e-437b-a17d-f58cbc159a90 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1757 microversion: 2.1 time: 0.219944 Aug 24 03:39:51.383185 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 417/827] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:51 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:51.501135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:51.502365 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:51.505176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:51.506319 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=6 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:51.515765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.516790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.517569 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.518838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.519585 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.521025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.707380 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:51.723362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-52220a6c-b08d-4c65-a4f6-97e97a944352 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.227041 Aug 24 03:39:51.724329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 411/828] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:51 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:52.409697 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.410683 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.414394 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=6 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:52.425636 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.426538 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.427395 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.429513 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.430368 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.431090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.639870 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:52.650314 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5790fc3f-9b6b-4645-bfb0-535c2fe83f94 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1760 microversion: 2.1 time: 0.248136 Aug 24 03:39:52.651068 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 418/829] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:52 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1760 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:52.754260 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.755032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.769229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.770790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.771826 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.774742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.774742 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.775228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.974425 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:52.986389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4f9d243d-341e-42b7-a84b-fecfa3bf1ef1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.237410 Aug 24 03:39:52.987311 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 412/830] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:52 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:53.755909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-c8dccaa2-d962-4dd2-989f-40ad31f04c3b req-12e2d22a-1317-47a6-9b40-382d98863a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a3ce71-d62f-4c9c-9458-35eed0f2cad2", "name": "network-vif-plugged", "status": "completed", "tag": "dede27de-7357-424e-b33b-d2709f04ce10"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:53.768602 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c8dccaa2-d962-4dd2-989f-40ad31f04c3b req-12e2d22a-1317-47a6-9b40-382d98863a86 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:53.769329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c8dccaa2-d962-4dd2-989f-40ad31f04c3b req-12e2d22a-1317-47a6-9b40-382d98863a86 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:53.769983 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c8dccaa2-d962-4dd2-989f-40ad31f04c3b req-12e2d22a-1317-47a6-9b40-382d98863a86 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:53.790105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-c8dccaa2-d962-4dd2-989f-40ad31f04c3b req-12e2d22a-1317-47a6-9b40-382d98863a86 service nova] Creating event network-vif-plugged:dede27de-7357-424e-b33b-d2709f04ce10 for instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 on hv-cinder-85426 Aug 24 03:39:53.797236 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-c8dccaa2-d962-4dd2-989f-40ad31f04c3b req-12e2d22a-1317-47a6-9b40-382d98863a86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047820 Aug 24 03:39:53.798084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 419/831] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:54.014141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:54.015005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:54.017334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:54.026974 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.028075 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.028754 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.029955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.030878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.031729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.385197 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:54.400790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2e9b7c84-17d0-4e8f-8997-3c0f6b0a7f4e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.390019 Aug 24 03:39:54.402252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 413/832] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:54 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:55.437651 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:55.438515 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:55.447901 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.448472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.448996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.449825 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.450367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.450871 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.619995 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:55.628552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-5267d9e4-b9b1-4c7f-b68c-9558dd8a01a1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1360 microversion: 2.1 time: 0.197292 Aug 24 03:39:55.629146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 420/833] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:55 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:56.651288 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:56.652219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:56.660514 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.661030 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.661472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.662190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.662832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.663292 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.840816 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:56.849900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fec14cc7-7254-4c54-b3cb-bd9e3fd2e18b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1545 microversion: 2.1 time: 0.203743 Aug 24 03:39:56.851426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 414/834] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:56 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1545 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:56.874008 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:56.874684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:56.882032 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.882788 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.883065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.883812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.884274 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.884698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.011575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-da1fd428-7d1c-4dca-a8f8-dccf950e1a1e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141598 Aug 24 03:39:57.012181 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 421/835] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:39:56 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:58.329396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-4df06540-2d74-4735-b071-a85ed1ef940f req-5f59407a-aaf7-4e03-957a-59bf81ee38e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a3ce71-d62f-4c9c-9458-35eed0f2cad2", "tag": "dede27de-7357-424e-b33b-d2709f04ce10"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:58.341517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4df06540-2d74-4735-b071-a85ed1ef940f req-5f59407a-aaf7-4e03-957a-59bf81ee38e8 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.342137 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4df06540-2d74-4735-b071-a85ed1ef940f req-5f59407a-aaf7-4e03-957a-59bf81ee38e8 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.342709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4df06540-2d74-4735-b071-a85ed1ef940f req-5f59407a-aaf7-4e03-957a-59bf81ee38e8 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.357105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-4df06540-2d74-4735-b071-a85ed1ef940f req-5f59407a-aaf7-4e03-957a-59bf81ee38e8 service nova] Creating event network-changed:dede27de-7357-424e-b33b-d2709f04ce10 for instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 on hv-cinder-85426 Aug 24 03:39:58.363912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-4df06540-2d74-4735-b071-a85ed1ef940f req-5f59407a-aaf7-4e03-957a-59bf81ee38e8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037957 Aug 24 03:39:58.364923 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 415/836] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:24.497604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:24.498482 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:24.511675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=39 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.512962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=74 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.525055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.525878 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.526720 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.528135 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.528859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.529795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.689384 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lazy-loading 'services' on Instance uuid 89f097f4-3522-408a-b729-f895148b7fbb {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:40:24.818378 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8e3a04c7-7f71-40f0-ad04-b4fe446d178c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "DELETE /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments/b6ad740e-77f3-4599-a3a6-ba887cce716b" status: 202 len: 0 microversion: 2.1 time: 0.327870 Aug 24 03:40:24.819710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 422/837] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:40:24 2022] DELETE /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments/b6ad740e-77f3-4599-a3a6-ba887cce716b => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:24.829355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=5 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.830454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=67 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.837702 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:24.841287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:24.866732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.867757 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.868492 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.869631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.870349 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.871044 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.924619 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ddfd79d7-aa15-44ef-b5c4-f7054059ba01 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097870 Aug 24 03:40:24.925507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 416/838] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:24 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:25.949437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:25.955896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:25.969298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.970291 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.971137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.972427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.973319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.974360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.036555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2f1dc4b3-629b-43c6-86a1-b5fc23118150 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097076 Aug 24 03:40:26.037393 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 423/839] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:25 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:27.056376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:27.060085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:27.070439 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.071231 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.071897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.072989 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.073714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.074354 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.125609 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-51c4b328-7e73-4a03-bd05-f6832a538e81 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076042 Aug 24 03:40:27.126464 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 417/840] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:27 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:40:27.271477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:27.272832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:27.284373 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.285255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.286064 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.287663 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.288437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.289154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.343717 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:27.491702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1fa99f6e-f639-40ce-85f1-ff3a57848878 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "DELETE /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 204 len: 0 microversion: 2.1 time: 0.226872 Aug 24 03:40:27.492638 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 424/841] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:27 2022] DELETE /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:27.505104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:27.506140 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:27.516219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.516997 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.517660 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.518846 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.519567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.520262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.713018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:27.722497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4ea1fdca-32c7-44e6-8675-bf2746a79879 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1689 microversion: 2.1 time: 0.223948 Aug 24 03:40:27.723301 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 418/842] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:27 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:28.751420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:28.752665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:28.764664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:28.765457 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:28.766225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:28.767512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:28.768338 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:28.769091 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.012630 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:29.027375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-569d55cf-4756-4308-a574-ed1545ad5515 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1689 microversion: 2.1 time: 0.283635 Aug 24 03:40:29.028373 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 425/843] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:28 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:30.067841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:30.068879 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:30.080564 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.081436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.082339 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.083895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.084743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.085511 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.333130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:30.345945 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-218ac29c-1c06-48a2-841e-e5a563758fde tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1689 microversion: 2.1 time: 0.284636 Aug 24 03:40:30.346852 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 419/844] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:30 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1689 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:31.380709 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:31.381883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:31.395391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:31.396906 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:31.397664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.399013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:31.399840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:31.400593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.654922 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:31.670189 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d84733d2-d35b-48e3-aa03-0677760594f6 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1689 microversion: 2.1 time: 0.297174 Aug 24 03:40:31.671305 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 426/845] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:31 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1689 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:32.709788 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:32.712603 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:32.724761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.725493 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.726156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.727410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.728116 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.728787 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.845580 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:32.860889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a2472249-1893-4bf7-9bb7-bc4105fdd76f tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1621 microversion: 2.1 time: 0.158332 Aug 24 03:40:32.861899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 420/846] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:32 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1621 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:33.327714 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-a3b74238-7384-4bcc-ab36-c20e1cc27db1 req-68533c23-9088-450b-b518-4b41c1b07858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f097f4-3522-408a-b729-f895148b7fbb", "name": "network-vif-deleted", "tag": "c6ee4054-246d-400d-a193-9ca2efe2b6d1"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:33.355261 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a3b74238-7384-4bcc-ab36-c20e1cc27db1 req-68533c23-9088-450b-b518-4b41c1b07858 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.356293 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a3b74238-7384-4bcc-ab36-c20e1cc27db1 req-68533c23-9088-450b-b518-4b41c1b07858 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.357007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a3b74238-7384-4bcc-ab36-c20e1cc27db1 req-68533c23-9088-450b-b518-4b41c1b07858 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.381707 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-a3b74238-7384-4bcc-ab36-c20e1cc27db1 req-68533c23-9088-450b-b518-4b41c1b07858 service nova] Creating event network-vif-deleted:c6ee4054-246d-400d-a193-9ca2efe2b6d1 for instance 89f097f4-3522-408a-b729-f895148b7fbb on hv-cinder-85426 Aug 24 03:40:33.391372 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-a3b74238-7384-4bcc-ab36-c20e1cc27db1 req-68533c23-9088-450b-b518-4b41c1b07858 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069633 Aug 24 03:40:33.393228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 427/847] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:33.895086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:33.896100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:33.906965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.907720 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.908393 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.909530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.910240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.910942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.966361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.967129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.967845 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.968545 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lazy-loading 'fault' on Instance uuid 89f097f4-3522-408a-b729-f895148b7fbb {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:40:34.039749 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.053389 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-04692051-1856-4dce-aee7-cafdd267c51c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 200 len: 1334 microversion: 2.1 time: 0.164732 Aug 24 03:40:34.054275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 421/848] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:33 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 1334 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:35.085591 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:35.086448 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 89f097f4-3522-408a-b729-f895148b7fbb] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:35.093836 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.094704 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.095503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.096475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.097090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.097591 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.114886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] HTTP exception thrown: Instance 89f097f4-3522-408a-b729-f895148b7fbb could not be found. Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Request method failure captured: Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb HTTP/1.1 Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZxAowYte1TnzkDC8E2BasP9nMh2qq3z0g6gLyXb4nCQOnft_YpKkhFXsYfauzVNMVRH3PUGTE25tn_8om-ND_s8ozoAvNgNctUS5PPDyME0f3EMBA398lqiTmDKCBU6tAHG7rKiyW0my49b3YO0CTLY9nfzNjyfDim3bydBtSaqdU4 Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:40:35.117415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66a102abeb7f46a292a49d1f022190e7"}]}] Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: ae4f7f8855b5445d863a825ce921c982 Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 89f097f4-3522-408a-b729-f895148b7fbb could not be found. Aug 24 03:40:35.120502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '89f097f4-3522-408a-b729-f895148b7fbb'} Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f097f4-3522-408a-b729-f895148b7fbb could not be found. Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:35.122050 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f097f4-3522-408a-b729-f895148b7fbb could not be found. Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f097f4-3522-408a-b729-f895148b7fbb could not be found. Aug 24 03:40:35.124850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:35.127782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Returning 404 to user: Instance 89f097f4-3522-408a-b729-f895148b7fbb could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:35.127782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-92ee1cc2-435b-4119-a57c-b1eb7222d288 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb" status: 404 len: 111 microversion: 2.1 time: 0.039689 Aug 24 03:40:35.127782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 428/849] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:35 2022] GET /compute/v2.1/servers/89f097f4-3522-408a-b729-f895148b7fbb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:35.133434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-47444770-da1f-4617-9f0a-b97d871fa418 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '.version_select at 0x7f4f4422f940>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:35.172229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-47444770-da1f-4617-9f0a-b97d871fa418 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-649500905" status: 202 len: 0 microversion: 2.1 time: 0.043766 Aug 24 03:40:35.173700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 422/850] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 24 03:40:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-649500905 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:38.573567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:38.574494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:38.587860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.588686 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.589432 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.590688 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.591450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.592168 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.643021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:38.763921 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-563f2253-e75b-45b3-8d42-a10e80f398d8 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "DELETE /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 204 len: 0 microversion: 2.1 time: 0.197215 Aug 24 03:40:38.764821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 429/851] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:38 2022] DELETE /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:38.776376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:38.777513 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:38.790216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.791028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.791731 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.792837 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.793564 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.794244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.990630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:39.005168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-33c04aa5-2955-41c7-a30f-d4c531105d1c tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1508 microversion: 2.1 time: 0.234602 Aug 24 03:40:39.006225 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 423/852] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:38 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:40.042112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:40.043210 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:40.054081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.054962 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.055728 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.057276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.058081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.058863 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.308345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.319037 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-95dfdc26-0339-49bb-8331-a1d5802c5469 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1508 microversion: 2.1 time: 0.283774 Aug 24 03:40:40.319785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 430/853] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:40 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:40.330327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:40.331391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:40.343857 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.344707 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.345203 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.345997 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.346502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.347031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.381220 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3e8d1a12-af0d-4870-9bcc-bba290a80d6b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/ips" status: 200 len: 149 microversion: 2.1 time: 0.058249 Aug 24 03:40:40.382262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 424/854] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:40:40 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:41.364310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:41.366176 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:41.376822 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.377679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.378430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.379807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.380524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.381264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.645288 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:41.663105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ea269fff-3769-4a4f-b392-e06d98ab4ac1 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 200 len: 1508 microversion: 2.1 time: 0.312619 Aug 24 03:40:41.664257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 431/855] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:41 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:41.823025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-5ef90d4e-e33e-46de-ad92-2bbe2f7af399 req-d2448312-b931-4288-ab5c-6bb08f224f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28871953-1a38-47d3-968e-1bb911d42077", "name": "network-vif-deleted", "tag": "3141fca6-9212-4b42-8107-08873cc7cd08"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:41.858912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-5ef90d4e-e33e-46de-ad92-2bbe2f7af399 req-d2448312-b931-4288-ab5c-6bb08f224f5a service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.860089 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-5ef90d4e-e33e-46de-ad92-2bbe2f7af399 req-d2448312-b931-4288-ab5c-6bb08f224f5a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.861076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-5ef90d4e-e33e-46de-ad92-2bbe2f7af399 req-d2448312-b931-4288-ab5c-6bb08f224f5a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.887017 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-5ef90d4e-e33e-46de-ad92-2bbe2f7af399 req-d2448312-b931-4288-ab5c-6bb08f224f5a service nova] Creating event network-vif-deleted:3141fca6-9212-4b42-8107-08873cc7cd08 for instance 28871953-1a38-47d3-968e-1bb911d42077 on hv-cinder-85426 Aug 24 03:40:41.897312 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-5ef90d4e-e33e-46de-ad92-2bbe2f7af399 req-d2448312-b931-4288-ab5c-6bb08f224f5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084858 Aug 24 03:40:41.898880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 425/856] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:40:42.053674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d8a62ef-08cb-4d61-909a-5ad64fcac755"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:42.057119 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:42.065166 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.065811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.066456 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.067485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.068058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.068601 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.643107 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3d5de30d-9100-42b3-8841-7932eae21a3e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593291 Aug 24 03:40:42.644460 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 432/857] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:40:42 2022] POST /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:42.711208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:42.712515 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: 28871953-1a38-47d3-968e-1bb911d42077] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:42.725195 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.725708 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.726916 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.728383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.729202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.729963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.765283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] HTTP exception thrown: Instance 28871953-1a38-47d3-968e-1bb911d42077 could not be found. Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Request method failure captured: Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 HTTP/1.1 Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZxAowYte1TnzkDC8E2BasP9nMh2qq3z0g6gLyXb4nCQOnft_YpKkhFXsYfauzVNMVRH3PUGTE25tn_8om-ND_s8ozoAvNgNctUS5PPDyME0f3EMBA398lqiTmDKCBU6tAHG7rKiyW0my49b3YO0CTLY9nfzNjyfDim3bydBtSaqdU4 Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:40:42.768537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66a102abeb7f46a292a49d1f022190e7"}]}] Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: ae4f7f8855b5445d863a825ce921c982 Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 28871953-1a38-47d3-968e-1bb911d42077 could not be found. Aug 24 03:40:42.771214 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '28871953-1a38-47d3-968e-1bb911d42077'} Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28871953-1a38-47d3-968e-1bb911d42077 could not be found. Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:42.772642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28871953-1a38-47d3-968e-1bb911d42077 could not be found. Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28871953-1a38-47d3-968e-1bb911d42077 could not be found. Aug 24 03:40:42.775229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:42.777859 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Returning 404 to user: Instance 28871953-1a38-47d3-968e-1bb911d42077 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:42.779461 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7acf2f51-301a-43fa-b165-e94b51f77429 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077" status: 404 len: 111 microversion: 2.1 time: 0.076256 Aug 24 03:40:42.780809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 426/858] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:42 2022] GET /compute/v2.1/servers/28871953-1a38-47d3-968e-1bb911d42077 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:42.802610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:42.802983 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:42.814972 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.815833 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.816608 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.817926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.818789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.819567 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.874275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:42.931873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:43.026047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d278b8cc-4630-4db9-8b1d-1a5e1b1a4357 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 204 len: 0 microversion: 2.1 time: 0.231050 Aug 24 03:40:43.027175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 433/859] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:42 2022] DELETE /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:43.040526 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:43.041476 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:43.051798 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:43.053068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:43.053769 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.054973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:43.055721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:43.056884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.259453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:43.269173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-766ac456-49f2-4de1-9735-1242701bf775 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.235642 Aug 24 03:40:43.269934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 427/860] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:43 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:44.307116 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:44.308244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:44.316528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.317253 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.318597 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.319478 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.320008 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.320484 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.510137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:44.525394 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-48c0dff8-780a-460a-ad36-e5a174015631 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.224048 Aug 24 03:40:44.526765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 434/861] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:44 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:45.552577 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.553659 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.566014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.566892 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.568381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.569899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.570735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.571487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.822546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.838208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a1058db4-27fa-4344-b30c-0b8766611c9a tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.292203 Aug 24 03:40:45.839729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 428/862] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:46.872939 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:46.873927 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:46.883493 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:46.884224 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:46.884774 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:46.885596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:46.886156 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:46.886811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.098148 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f7f8855b5445d863a825ce921c982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a102abeb7f46a292a49d1f022190e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.116758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ee0af286-489a-4693-b726-43f8cb789990 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 200 len: 1521 microversion: 2.1 time: 0.249992 Aug 24 03:40:47.118721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 435/863] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:46 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:47.163436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-a1ecb1f0-90da-4fd5-adbf-7ace04bde2a1 req-ac68282a-271c-4115-b64f-eea02feafb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14a955e-8274-4ad0-af0d-a9e41d7bade7", "name": "network-vif-deleted", "tag": "c96315d0-bdcc-4083-a370-1f4ff17b9596"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:47.186756 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a1ecb1f0-90da-4fd5-adbf-7ace04bde2a1 req-ac68282a-271c-4115-b64f-eea02feafb60 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.187516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a1ecb1f0-90da-4fd5-adbf-7ace04bde2a1 req-ac68282a-271c-4115-b64f-eea02feafb60 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.188165 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a1ecb1f0-90da-4fd5-adbf-7ace04bde2a1 req-ac68282a-271c-4115-b64f-eea02feafb60 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.216574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-a1ecb1f0-90da-4fd5-adbf-7ace04bde2a1 req-ac68282a-271c-4115-b64f-eea02feafb60 service nova] Creating event network-vif-deleted:c96315d0-bdcc-4083-a370-1f4ff17b9596 for instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 on hv-cinder-85426 Aug 24 03:40:47.225959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-a1ecb1f0-90da-4fd5-adbf-7ace04bde2a1 req-ac68282a-271c-4115-b64f-eea02feafb60 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068332 Aug 24 03:40:47.226995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 429/864] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:47.342787 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d8a62ef-08cb-4d61-909a-5ad64fcac755"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:47.345438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.353831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.354683 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.355437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.356644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.357438 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.358190 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.490428 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Invalid volume: volume 8d8a62ef-08cb-4d61-909a-5ad64fcac755 is already attached to instances: c745a230-ab54-4a5f-8a4d-d5a785f3c59a Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: POST /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments HTTP/1.1 Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 74 Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:40:47.494194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {"volumeAttachment": {"volumeId": "8d8a62ef-08cb-4d61-909a-5ad64fcac755"}} Aug 24 03:40:47.496084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Invalid volume: volume 8d8a62ef-08cb-4d61-909a-5ad64fcac755 is already attached to instances: c745a230-ab54-4a5f-8a4d-d5a785f3c59a Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'server_id': 'c745a230-ab54-4a5f-8a4d-d5a785f3c59a', 'body': {'volumeAttachment': {'volumeId': '8d8a62ef-08cb-4d61-909a-5ad64fcac755'}}} Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8d8a62ef-08cb-4d61-909a-5ad64fcac755 is already attached to instances: c745a230-ab54-4a5f-8a4d-d5a785f3c59a Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:47.497012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8d8a62ef-08cb-4d61-909a-5ad64fcac755 is already attached to instances: c745a230-ab54-4a5f-8a4d-d5a785f3c59a Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:47.499754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8d8a62ef-08cb-4d61-909a-5ad64fcac755 is already attached to instances: c745a230-ab54-4a5f-8a4d-d5a785f3c59a Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 400 to user: Invalid volume: volume 8d8a62ef-08cb-4d61-909a-5ad64fcac755 is already attached to instances: c745a230-ab54-4a5f-8a4d-d5a785f3c59a {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b5e487d3-e911-4d6f-989b-04d10fc6a93b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.158559 Aug 24 03:40:47.503584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 436/865] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:40:47 2022] POST /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:40:47.599738 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.600773 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.611813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.612475 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.613084 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.614209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.614927 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.615586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.729297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lazy-loading 'services' on Instance uuid c745a230-ab54-4a5f-8a4d-d5a785f3c59a {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:40:47.828121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b3a82d76-67a9-4259-95cf-72747902788b tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments/8d8a62ef-08cb-4d61-909a-5ad64fcac755" status: 202 len: 0 microversion: 2.1 time: 0.234100 Aug 24 03:40:47.828882 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 430/866] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:40:47 2022] DELETE /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments/8d8a62ef-08cb-4d61-909a-5ad64fcac755 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:40:47.842538 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.846548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.857647 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.858449 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.859317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.860643 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.861444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.862184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.938924 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-eebc40cc-61b3-4fbe-9bcd-ebcfc726a3fe tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103920 Aug 24 03:40:47.940123 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 437/867] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:47 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:40:48.153625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:48.154792 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] [instance: c14a955e-8274-4ad0-af0d-a9e41d7bade7] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:48.167543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.169218 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.170080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.171481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.172274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.172900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.202256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] HTTP exception thrown: Instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 could not be found. Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Request method failure captured: Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 HTTP/1.1 Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZxAowYte1TnzkDC8E2BasP9nMh2qq3z0g6gLyXb4nCQOnft_YpKkhFXsYfauzVNMVRH3PUGTE25tn_8om-ND_s8ozoAvNgNctUS5PPDyME0f3EMBA398lqiTmDKCBU6tAHG7rKiyW0my49b3YO0CTLY9nfzNjyfDim3bydBtSaqdU4 Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:40:48.205466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66a102abeb7f46a292a49d1f022190e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66a102abeb7f46a292a49d1f022190e7"}]}] Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 66a102abeb7f46a292a49d1f022190e7 Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854627763 Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: ae4f7f8855b5445d863a825ce921c982 Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854627763-project Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 could not be found. Aug 24 03:40:48.208013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'c14a955e-8274-4ad0-af0d-a9e41d7bade7'} Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 could not be found. Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:48.209435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 could not be found. Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 could not be found. Aug 24 03:40:48.211733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:48.213701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] Returning 404 to user: Instance c14a955e-8274-4ad0-af0d-a9e41d7bade7 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:48.213701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1c4e71b4-6fed-4db6-8d5a-aa3223be95c4 tempest-ServerRescueNegativeTestJSON-1854627763 tempest-ServerRescueNegativeTestJSON-1854627763-project] 10.222.0.78 "GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7" status: 404 len: 111 microversion: 2.1 time: 0.063611 Aug 24 03:40:48.213701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 431/868] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:48 2022] GET /compute/v2.1/servers/c14a955e-8274-4ad0-af0d-a9e41d7bade7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:48.966818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:48.972157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:48.986210 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.987710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.989058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.991597 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.992447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.993507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.062263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-65678d43-480b-43fd-8572-9b8c820d818f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110883 Aug 24 03:40:49.063355 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 438/869] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:48 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:50.082993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:50.086807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:50.097701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.098512 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.099878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.101131 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.101813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.102719 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.153115 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9f5b719c-4672-419a-bd8c-7dba529c374c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076683 Aug 24 03:40:50.162098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 432/870] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:50 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:40:50.265536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:50.266385 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:50.276504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.277314 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.278022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.279193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.279910 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.280588 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.328802 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:50.477885 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-33271f25-d970-4938-b0d7-dc841fa9b6a2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 204 len: 0 microversion: 2.1 time: 0.218180 Aug 24 03:40:50.479223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 439/871] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:50 2022] DELETE /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:50.494147 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:50.495390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:50.506278 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.507270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.508112 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.509450 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.510367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.511168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.710169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:50.725814 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-07c8e4d4-981e-4440-ba2f-08501482c01e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1682 microversion: 2.1 time: 0.238849 Aug 24 03:40:50.726920 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 433/872] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:50 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:51.761252 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:51.762337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:51.773989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.774908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.775923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.777468 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.778279 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.779065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.971933 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.984520 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-be638b84-67a7-43ac-9ffe-279720782430 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1682 microversion: 2.1 time: 0.231683 Aug 24 03:40:51.986716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 440/873] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:51 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:53.024238 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:53.025407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:53.040602 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:53.041403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:53.042210 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:53.043639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:53.044412 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:53.045128 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:53.297289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:53.314062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-dfad74db-55e9-4c39-911a-3bda2c9b31d9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1682 microversion: 2.1 time: 0.296535 Aug 24 03:40:53.315118 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 434/874] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:53 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1682 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:54.345792 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:54.347675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:54.359000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.359761 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.360420 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.361510 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.362203 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.362877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.497939 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:54.513944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-266b4cb2-372f-4a23-83b0-9f19af1845a1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1614 microversion: 2.1 time: 0.174557 Aug 24 03:40:54.515639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 441/875] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:54 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1614 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:55.286255 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-e68345e2-235b-4820-911b-d0bb0a0175cb req-609aef40-e2f0-496c-ac05-ef5956290e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c745a230-ab54-4a5f-8a4d-d5a785f3c59a", "name": "network-vif-deleted", "tag": "7eb8ce42-ca79-4063-ae5f-34844ff69af9"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:55.306906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:55.317287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e68345e2-235b-4820-911b-d0bb0a0175cb req-609aef40-e2f0-496c-ac05-ef5956290e99 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.318151 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e68345e2-235b-4820-911b-d0bb0a0175cb req-609aef40-e2f0-496c-ac05-ef5956290e99 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.318851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e68345e2-235b-4820-911b-d0bb0a0175cb req-609aef40-e2f0-496c-ac05-ef5956290e99 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:55.338700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:55.359377 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-e68345e2-235b-4820-911b-d0bb0a0175cb req-609aef40-e2f0-496c-ac05-ef5956290e99 service nova] Creating event network-vif-deleted:7eb8ce42-ca79-4063-ae5f-34844ff69af9 for instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a on hv-cinder-85426 Aug 24 03:40:55.371975 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-e68345e2-235b-4820-911b-d0bb0a0175cb req-609aef40-e2f0-496c-ac05-ef5956290e99 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095537 Aug 24 03:40:55.374065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 435/876] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:55.558226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:55.560434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:55.567404 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=4 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:55.576384 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.577293 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.578613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:55.579887 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.581754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.583532 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:55.653731 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.654922 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.656007 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:55.657841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lazy-loading 'fault' on Instance uuid c745a230-ab54-4a5f-8a4d-d5a785f3c59a {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:40:55.764596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:55.780039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-08b59271-4b16-4093-90cd-3d8471155795 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 200 len: 1332 microversion: 2.1 time: 0.230871 Aug 24 03:40:55.781816 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 442/877] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:55 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:56.821125 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.822307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:56.832867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.833722 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.834271 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.835338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.836025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.836638 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.860703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a HTTP/1.1 Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:40:56.862696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:40:56.866177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'c745a230-ab54-4a5f-8a4d-d5a785f3c59a'} Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:56.867381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:40:56.869145 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.870596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:56.870596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a7ff0727-d622-4085-b58a-6edd1cdbf1dd tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 404 len: 111 microversion: 2.1 time: 0.055257 Aug 24 03:40:56.870596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 436/878] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:56 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:56.878352 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-86efa1bd-766e-4cc7-8542-4e3f50918558 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '.version_select at 0x7f4f4427a820>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.916963 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-86efa1bd-766e-4cc7-8542-4e3f50918558 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983605798" status: 202 len: 0 microversion: 2.1 time: 0.043920 Aug 24 03:40:56.917661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 443/879] 10.222.0.78 () {58 vars in 1221 bytes} [Wed Aug 24 03:40:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983605798 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:57.884668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-09031155-d4a1-4ed9-8578-ee1bf8f0860c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: .version_select at 0x7f4f443620d0>, body: {"keypair": {"name": "tempest-keypair-1705504263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyccUATKuJTYJavF+HioLIINYDSSHZ/IJdvxlZUwq35FqavKAXj7EBTnh4hV74UFMGb1ew8jZnjwRptf2MeXAmUHOC5c8B5kwVETJGby+aE4v9cX1zoqZwbadOe2Lfd0w=="}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:57.907771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-09031155-d4a1-4ed9-8578-ee1bf8f0860c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:57.914346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-09031155-d4a1-4ed9-8578-ee1bf8f0860c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'key_pairs'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:57.949524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-09031155-d4a1-4ed9-8578-ee1bf8f0860c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070018 Aug 24 03:40:57.950573 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 437/880] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:40:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:41:00.400849 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-952675430", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f5f140-61b8-4d93-a685-1b439b420020"}], "security_groups": [{"name": "tempest-securitygroup--70211680"}], "key_name": "tempest-keypair-1705504263", "user_data": "}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:00.596936 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] validate_networks() for [('f9f5f140-61b8-4d93-a685-1b439b420020', None, None, None, None, None)] {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:41:01.254200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:41:01.254893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:41:01.255640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:41:01.256277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:41:01.256933 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:41:01.271726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.272473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.273134 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.274315 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.275052 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.275688 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.306128 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:01.313565 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Getting quotas for user f447a34300944a5da25f6408f802f602 and project 3989b5dc1ded4718af973b4e794ff1be. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:01.333263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:41:01.337043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:41:01.428627 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8f516188-2d48-4dce-9392-740304675f02 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.036874 Aug 24 03:41:01.429726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 444/881] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:41:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:41:01.448278 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6eb17be6-1c8c-48e3-a1ac-a93fbd6f36ae tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:01.449240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6eb17be6-1c8c-48e3-a1ac-a93fbd6f36ae tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:01.551554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6eb17be6-1c8c-48e3-a1ac-a93fbd6f36ae tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:01.564487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6eb17be6-1c8c-48e3-a1ac-a93fbd6f36ae tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1241 microversion: 2.1 time: 0.122950 Aug 24 03:41:01.571646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 438/882] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:01 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:02.599923 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:02.600816 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:02.613070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.615377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.615377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.616471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.617208 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.617855 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.738103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:02.751942 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-59c0236a-8366-4f2e-a6ab-7130cf87cb1f tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1293 microversion: 2.1 time: 0.159508 Aug 24 03:41:02.752841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 445/883] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:02 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:03.785616 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:03.786685 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:03.798840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:03.799713 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:03.800429 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:03.801849 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:03.802692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:03.803766 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:03.920367 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:03.933853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1b1fa403-398b-47fe-aad7-aa692f295255 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1299 microversion: 2.1 time: 0.154882 Aug 24 03:41:03.951163 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 439/884] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:03 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:04.968459 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:04.970367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:04.981648 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:04.982395 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:04.983138 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:04.984277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:04.985020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:04.985703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:05.229809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:05.245569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-741479ea-ca75-47de-b368-05a10648e8f5 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.283679 Aug 24 03:41:05.246606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 446/885] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:04 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:05.296582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-f24e1338-1acf-4f97-97e8-478ef9ad391f req-acd82117-7ef2-4a80-872d-29493555b6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b", "tag": "8cc0756e-9952-409d-93e4-903c592a19df"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:05.322000 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-f24e1338-1acf-4f97-97e8-478ef9ad391f req-acd82117-7ef2-4a80-872d-29493555b6df service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:05.322873 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-f24e1338-1acf-4f97-97e8-478ef9ad391f req-acd82117-7ef2-4a80-872d-29493555b6df service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:05.323695 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-f24e1338-1acf-4f97-97e8-478ef9ad391f req-acd82117-7ef2-4a80-872d-29493555b6df service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:05.344801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-f24e1338-1acf-4f97-97e8-478ef9ad391f req-acd82117-7ef2-4a80-872d-29493555b6df service nova] Creating event network-changed:8cc0756e-9952-409d-93e4-903c592a19df for instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b on hv-cinder-85426 Aug 24 03:41:05.353836 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-f24e1338-1acf-4f97-97e8-478ef9ad391f req-acd82117-7ef2-4a80-872d-29493555b6df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073504 Aug 24 03:41:05.355327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 440/886] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:06.284333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:06.286598 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:06.297663 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.298388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.299087 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.300176 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.300909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.301582 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.509301 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:06.518555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9917345f-4577-4737-8a90-644f108c626d tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.241248 Aug 24 03:41:06.519203 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 447/887] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:06 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:07.546245 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:07.547378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:07.557910 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.558646 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.559355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.560420 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.561113 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.561758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.798793 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:07.813481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a04773eb-c3c9-40f2-8807-e676f4cab7a4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.274663 Aug 24 03:41:07.814462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 441/888] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:07 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:08.849172 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:08.850305 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:08.865665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.865665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.866237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.868224 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.869073 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.869817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:09.108317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:09.121905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7e22b670-3a26-48a4-9a35-ac92b8965c8e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.280618 Aug 24 03:41:09.122628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 448/889] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:08 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:10.164120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:10.165254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:10.181682 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.183632 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.184412 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.185648 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.186437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.187204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.435350 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:10.449678 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-77373a1e-ce6e-494c-86a7-aec5eaee4682 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.294941 Aug 24 03:41:10.450710 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 442/890] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:10 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:10.781560 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1379441741"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:10.782298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:10.789593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.790099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.790542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.791321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.791795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.792225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.796761 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:10.951036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.network.security_group_api [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Removing security group 93a94113-237d-4095-9488-abac51aa209b from port 8f793c88-f2e7-4c15-84bf-8bcd6407f687 Aug 24 03:41:11.285784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:11.324914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=6 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:11.414298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-eb079065-8eb8-4a36-908f-a069f4a6205b tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/action" status: 202 len: 0 microversion: 2.1 time: 0.636361 Aug 24 03:41:11.416083 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 449/891] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:10 2022] POST /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:41:11.448869 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-35c42a2d-382c-4217-b6a7-909b85680e01 req-f90419e2-7929-4aae-8e7f-a3c6a96ee597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b212009b-b39e-44d4-901f-dae732632529", "tag": "8f793c88-f2e7-4c15-84bf-8bcd6407f687"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:11.469597 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-35c42a2d-382c-4217-b6a7-909b85680e01 req-f90419e2-7929-4aae-8e7f-a3c6a96ee597 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.470873 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-35c42a2d-382c-4217-b6a7-909b85680e01 req-f90419e2-7929-4aae-8e7f-a3c6a96ee597 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.471870 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-35c42a2d-382c-4217-b6a7-909b85680e01 req-f90419e2-7929-4aae-8e7f-a3c6a96ee597 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.489943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:11.495003 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:11.506590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-35c42a2d-382c-4217-b6a7-909b85680e01 req-f90419e2-7929-4aae-8e7f-a3c6a96ee597 service nova] Creating event network-changed:8f793c88-f2e7-4c15-84bf-8bcd6407f687 for instance b212009b-b39e-44d4-901f-dae732632529 on hv-cinder-85426 Aug 24 03:41:11.521273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.522098 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.527872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.530434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.531806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.533336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.535488 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-35c42a2d-382c-4217-b6a7-909b85680e01 req-f90419e2-7929-4aae-8e7f-a3c6a96ee597 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092762 Aug 24 03:41:11.537169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 443/892] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:11.869309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:11.885233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3871b4db-eb0a-41e7-840c-c059e95482aa tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.404329 Aug 24 03:41:11.886175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 450/893] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:11 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:12.912418 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=6 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:12.918050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:12.918740 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:12.927077 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.927568 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.928024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:12.928790 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.929263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.929702 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.316554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:13.335979 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-785c8008-e7cc-4827-aeb5-ba4336cae1f1 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.424222 Aug 24 03:41:13.336737 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 444/894] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:12 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:13.760507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:13.762784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:13.768011 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-4f08b45a-6543-4854-9720-0a45ca246edd req-30ffe739-d189-4378-8c60-0369a9d234b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b212009b-b39e-44d4-901f-dae732632529", "tag": "8f793c88-f2e7-4c15-84bf-8bcd6407f687"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:13.772042 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.773013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.773658 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.774599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.775301 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.775893 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.786248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4f08b45a-6543-4854-9720-0a45ca246edd req-30ffe739-d189-4378-8c60-0369a9d234b5 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.787152 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4f08b45a-6543-4854-9720-0a45ca246edd req-30ffe739-d189-4378-8c60-0369a9d234b5 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.788244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-4f08b45a-6543-4854-9720-0a45ca246edd req-30ffe739-d189-4378-8c60-0369a9d234b5 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.813381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-4f08b45a-6543-4854-9720-0a45ca246edd req-30ffe739-d189-4378-8c60-0369a9d234b5 service nova] Creating event network-changed:8f793c88-f2e7-4c15-84bf-8bcd6407f687 for instance b212009b-b39e-44d4-901f-dae732632529 on hv-cinder-85426 Aug 24 03:41:13.824258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-4f08b45a-6543-4854-9720-0a45ca246edd req-30ffe739-d189-4378-8c60-0369a9d234b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062935 Aug 24 03:41:13.825442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 445/895] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:41:13.940245 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lazy-loading 'services' on Instance uuid b212009b-b39e-44d4-901f-dae732632529 {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:14.063720 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-441a6de9-a7e1-4193-8424-6838f0be8b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments/fcc9c617-6128-4e4b-b204-8f5ef6173486" status: 202 len: 0 microversion: 2.1 time: 0.310724 Aug 24 03:41:14.069225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 451/896] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:41:13 2022] DELETE /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments/fcc9c617-6128-4e4b-b204-8f5ef6173486 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:14.081781 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:14.088727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:14.112293 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.113977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.116974 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.119256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.119256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.119918 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.221910 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7645a6d5-49ec-422d-a655-12575dea4b47 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141834 Aug 24 03:41:14.224270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 446/897] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:14 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:14.369196 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:14.370564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:14.398569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.399836 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.401304 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.404667 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.406590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.407352 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.679321 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:14.690904 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-71d771d8-ccb0-4674-8c98-25ee595c4509 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.329732 Aug 24 03:41:14.692498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 452/898] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:14 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:14.702979 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-eb798b1e-a336-499c-ac92-ac71fb12d02f req-84e99418-23c9-416d-9cc4-817ea9fb9214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b", "name": "network-vif-plugged", "status": "completed", "tag": "8cc0756e-9952-409d-93e4-903c592a19df"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:14.717008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-eb798b1e-a336-499c-ac92-ac71fb12d02f req-84e99418-23c9-416d-9cc4-817ea9fb9214 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.717855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-eb798b1e-a336-499c-ac92-ac71fb12d02f req-84e99418-23c9-416d-9cc4-817ea9fb9214 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.718617 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-eb798b1e-a336-499c-ac92-ac71fb12d02f req-84e99418-23c9-416d-9cc4-817ea9fb9214 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.743853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-eb798b1e-a336-499c-ac92-ac71fb12d02f req-84e99418-23c9-416d-9cc4-817ea9fb9214 service nova] Creating event network-vif-plugged:8cc0756e-9952-409d-93e4-903c592a19df for instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b on hv-cinder-85426 Aug 24 03:41:14.753977 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-eb798b1e-a336-499c-ac92-ac71fb12d02f req-84e99418-23c9-416d-9cc4-817ea9fb9214 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058353 Aug 24 03:41:14.755167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 447/899] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:15.244182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:15.249603 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:15.263860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.265014 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.266256 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.268032 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.270409 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.270409 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.314262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ccb4e617-e5f6-4e0d-b5a3-5e500f0f473f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080193 Aug 24 03:41:15.314899 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 453/900] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:15 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:15.741896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:15.741896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:15.752252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.753489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.754320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.757240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.757240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.757849 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.946960 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:15.957198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-793a5690-07d2-4bef-946a-72a329a3cd12 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1365 microversion: 2.1 time: 0.226968 Aug 24 03:41:15.958068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 448/901] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:15 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:16.330013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:16.333692 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:16.341949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.342444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.342949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.343674 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.344127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.344553 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.381616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-42756b30-b92f-48c0-9b3e-51a662490afc tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056383 Aug 24 03:41:16.382293 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 454/902] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:16 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:41:16.394559 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:16.395366 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:16.402740 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.403275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.403733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.404622 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.405129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.405558 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.503110 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] HTTP exception thrown: Instance b212009b-b39e-44d4-901f-dae732632529 is not attached to volume fcc9c617-6128-4e4b-b204-8f5ef6173486 Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Request method failure captured: Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: DELETE /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments/fcc9c617-6128-4e4b-b204-8f5ef6173486 HTTP/1.1 Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZy9utR7IRAk09eGE_vTDa0oLgLCcqwOEstm92VYWvW059_d3-_W1DKKE8e1ujyToOqDBYi5wmVq-Ls_JR1FvvUkd3n-kKMbrJlKC1eFv4siqVZS_OdbwBqnxyjFFZiTwnupdcS7_uH6uPgjTwAz-3Z9FM66sX-bToDocvA7KKqocZk Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: f0af57c134de4e0a888e90e50510d915 Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-TestMinimumBasicScenario-348341616 Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:41:16.505956 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0af57c134de4e0a888e90e50510d915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0af57c134de4e0a888e90e50510d915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0af57c134de4e0a888e90e50510d915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0af57c134de4e0a888e90e50510d915"}]}] Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-TestMinimumBasicScenario-348341616 Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: f0af57c134de4e0a888e90e50510d915 Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-TestMinimumBasicScenario-348341616 Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-TestMinimumBasicScenario-348341616-project Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: b829d1bdf9764cefa06ca6f9c5f69296 Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-TestMinimumBasicScenario-348341616-project Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:41:16.508729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance b212009b-b39e-44d4-901f-dae732632529 is not attached to volume fcc9c617-6128-4e4b-b204-8f5ef6173486 Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'server_id': 'b212009b-b39e-44d4-901f-dae732632529', 'id': 'fcc9c617-6128-4e4b-b204-8f5ef6173486'} Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fcc9c617-6128-4e4b-b204-8f5ef6173486. Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:16.510331 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b212009b-b39e-44d4-901f-dae732632529 is not attached to volume fcc9c617-6128-4e4b-b204-8f5ef6173486 Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b212009b-b39e-44d4-901f-dae732632529 is not attached to volume fcc9c617-6128-4e4b-b204-8f5ef6173486 Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:16.513346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Returning 404 to user: Instance b212009b-b39e-44d4-901f-dae732632529 is not attached to volume fcc9c617-6128-4e4b-b204-8f5ef6173486 {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:16.515087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a7f50ca8-98f1-490b-ab94-3f111c235088 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments/fcc9c617-6128-4e4b-b204-8f5ef6173486" status: 404 len: 154 microversion: 2.1 time: 0.117391 Aug 24 03:41:16.515087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 449/903] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:41:16 2022] DELETE /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529/os-volume_attachments/fcc9c617-6128-4e4b-b204-8f5ef6173486 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:16.983537 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:16.984759 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:16.995178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.995800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.996327 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.997148 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.997693 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.998210 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.176698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:17.185631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8bca353a-7d22-4b77-bdd5-f02e84ff697a tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1555 microversion: 2.1 time: 0.209503 Aug 24 03:41:17.186228 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 455/904] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:16 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:17.206540 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.207397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.214349 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.214883 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.215311 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.216028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.216475 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.216889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.305924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-56ffc66b-dd59-49d5-9f2b-dcbd1d0bbea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103275 Aug 24 03:41:17.306967 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 450/905] 10.222.0.78 () {58 vars in 1275 bytes} [Wed Aug 24 03:41:17 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:17.686984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.687900 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.699990 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.700878 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.701666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.703043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.703888 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.704734 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.757123 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:41:17.883021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d6a3d8cb-08cf-485f-8b81-efa4a4fd321f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 204 len: 0 microversion: 2.1 time: 0.202840 Aug 24 03:41:17.883977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 456/906] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:41:17 2022] DELETE /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:41:17.893687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.894609 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.902571 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.903328 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.903748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.904546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.905069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.905567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:18.423735 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:18.440043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-434d6df2-27b1-4d94-bf97-06f2784b1b29 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1554 microversion: 2.1 time: 0.551134 Aug 24 03:41:18.441210 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 451/907] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:17 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1554 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:18.753345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-a5e8b245-3d6b-4812-ae9e-2493639fc22f req-49f78c8d-73e1-43a0-9ede-3fc282792685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b", "tag": "8cc0756e-9952-409d-93e4-903c592a19df"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:18.765268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a5e8b245-3d6b-4812-ae9e-2493639fc22f req-49f78c8d-73e1-43a0-9ede-3fc282792685 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:18.765848 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a5e8b245-3d6b-4812-ae9e-2493639fc22f req-49f78c8d-73e1-43a0-9ede-3fc282792685 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:18.766350 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-a5e8b245-3d6b-4812-ae9e-2493639fc22f req-49f78c8d-73e1-43a0-9ede-3fc282792685 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:18.781223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-a5e8b245-3d6b-4812-ae9e-2493639fc22f req-49f78c8d-73e1-43a0-9ede-3fc282792685 service nova] Creating event network-changed:8cc0756e-9952-409d-93e4-903c592a19df for instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b on hv-cinder-85426 Aug 24 03:41:18.787116 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-a5e8b245-3d6b-4812-ae9e-2493639fc22f req-49f78c8d-73e1-43a0-9ede-3fc282792685 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038299 Aug 24 03:41:18.788173 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 457/908] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:19.476819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:19.477497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:19.484947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:19.485453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:19.486132 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:19.487027 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:19.487501 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:19.488268 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:19.694780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:19.708812 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5a36d877-286a-4ef8-a7f0-a0272e813bd8 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1554 microversion: 2.1 time: 0.236602 Aug 24 03:41:19.709861 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 452/909] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:19 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:20.748903 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:20.751125 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:20.760843 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:20.762090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:20.762890 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:20.764162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:20.764986 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:20.765737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:20.940397 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:20.955414 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-59800308-4b10-4b99-9e61-a716003fbb83 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1554 microversion: 2.1 time: 0.214277 Aug 24 03:41:20.956285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 458/910] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:20 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:21.268924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-3a7bf978-65d6-4e0b-ab89-07acf3b66bcf req-477e9d3a-e6f2-43f5-b46d-cdf50ab572af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b212009b-b39e-44d4-901f-dae732632529", "name": "network-vif-deleted", "tag": "8f793c88-f2e7-4c15-84bf-8bcd6407f687"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:21.279871 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3a7bf978-65d6-4e0b-ab89-07acf3b66bcf req-477e9d3a-e6f2-43f5-b46d-cdf50ab572af service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:21.280357 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3a7bf978-65d6-4e0b-ab89-07acf3b66bcf req-477e9d3a-e6f2-43f5-b46d-cdf50ab572af service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:21.280827 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3a7bf978-65d6-4e0b-ab89-07acf3b66bcf req-477e9d3a-e6f2-43f5-b46d-cdf50ab572af service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:21.295052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-3a7bf978-65d6-4e0b-ab89-07acf3b66bcf req-477e9d3a-e6f2-43f5-b46d-cdf50ab572af service nova] Creating event network-vif-deleted:8f793c88-f2e7-4c15-84bf-8bcd6407f687 for instance b212009b-b39e-44d4-901f-dae732632529 on hv-cinder-85426 Aug 24 03:41:21.300750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-3a7bf978-65d6-4e0b-ab89-07acf3b66bcf req-477e9d3a-e6f2-43f5-b46d-cdf50ab572af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035721 Aug 24 03:41:21.301762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 453/911] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:21.978739 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:21.979648 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:21.987903 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:21.988860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:21.989511 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:21.990713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:21.990713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:21.991127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:22.032183 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:22.032975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:22.033576 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:22.034237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lazy-loading 'fault' on Instance uuid b212009b-b39e-44d4-901f-dae732632529 {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:22.092876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b829d1bdf9764cefa06ca6f9c5f69296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af57c134de4e0a888e90e50510d915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:22.107399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-61bddb3f-a3da-4eaf-9c5f-97a3c79a551f tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 200 len: 1348 microversion: 2.1 time: 0.132794 Aug 24 03:41:22.108460 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 459/912] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:21 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 1348 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:23.143611 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:23.144546 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] [instance: b212009b-b39e-44d4-901f-dae732632529] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:23.155099 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:23.155996 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:23.156795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:23.158167 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:23.159102 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:23.160853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:23.187207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] HTTP exception thrown: Instance b212009b-b39e-44d4-901f-dae732632529 could not be found. Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Request method failure captured: Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 HTTP/1.1 Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZy9utR7IRAk09eGE_vTDa0oLgLCcqwOEstm92VYWvW059_d3-_W1DKKE8e1ujyToOqDBYi5wmVq-Ls_JR1FvvUkd3n-kKMbrJlKC1eFv4siqVZS_OdbwBqnxyjFFZiTwnupdcS7_uH6uPgjTwAz-3Z9FM66sX-bToDocvA7KKqocZk Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: f0af57c134de4e0a888e90e50510d915 Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-TestMinimumBasicScenario-348341616 Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:41:23.190320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0af57c134de4e0a888e90e50510d915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0af57c134de4e0a888e90e50510d915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0af57c134de4e0a888e90e50510d915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0af57c134de4e0a888e90e50510d915"}]}] Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-TestMinimumBasicScenario-348341616 Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: f0af57c134de4e0a888e90e50510d915 Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-TestMinimumBasicScenario-348341616 Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-TestMinimumBasicScenario-348341616-project Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: b829d1bdf9764cefa06ca6f9c5f69296 Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-TestMinimumBasicScenario-348341616-project Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance b212009b-b39e-44d4-901f-dae732632529 could not be found. Aug 24 03:41:23.193453 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'b212009b-b39e-44d4-901f-dae732632529'} Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b212009b-b39e-44d4-901f-dae732632529 could not be found. Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:23.194472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b212009b-b39e-44d4-901f-dae732632529 could not be found. Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b212009b-b39e-44d4-901f-dae732632529 could not be found. Aug 24 03:41:23.196721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:23.198437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Returning 404 to user: Instance b212009b-b39e-44d4-901f-dae732632529 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:23.198437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-beb77701-5a92-49af-b2cb-4ca33d488d2a tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529" status: 404 len: 111 microversion: 2.1 time: 0.054605 Aug 24 03:41:23.198437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 454/913] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:23 2022] GET /compute/v2.1/servers/b212009b-b39e-44d4-901f-dae732632529 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:41:23.208390 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c8488926-f2f0-4744-bdf0-c41259c842c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] Calling method '.version_select at 0x7f4f4428cdc0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:23.241188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c8488926-f2f0-4744-bdf0-c41259c842c0 tempest-TestMinimumBasicScenario-348341616 tempest-TestMinimumBasicScenario-348341616-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1329602727" status: 202 len: 0 microversion: 2.1 time: 0.040039 Aug 24 03:41:23.241880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 460/914] 10.222.0.78 () {58 vars in 1272 bytes} [Wed Aug 24 03:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1329602727 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:28.139396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:28.140568 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:28.147520 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:28.149954 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:28.163686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:28.169050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:28.170136 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:28.170633 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:28.171146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:28.182261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=74 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:28.214139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8200f9a2-8629-4507-bb90-464682228c9e tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/ips" status: 200 len: 144 microversion: 2.1 time: 0.078785 Aug 24 03:41:28.215077 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 455/915] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:41:28 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/ips => generated 144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:29.739838 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a43dc68-5738-4438-a9b3-93368faf3278"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:29.742629 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:29.745381 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:29.755396 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.756280 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.757518 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.758536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.759097 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.759670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:30.185219 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4e7585db-2a87-4802-986f-0eaafc0515a6 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452252 Aug 24 03:41:30.186319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 461/916] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:41:29 2022] POST /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:31.199781 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:31.201038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:31.209149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.209676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.210335 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.211120 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.211581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.212017 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.258144 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bc3eac08-dcbf-4cc3-9aa1-185cde1bc3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/ips" status: 200 len: 152 microversion: 2.20 time: 0.059332 Aug 24 03:41:31.264272 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 456/917] 10.222.0.78 () {60 vars in 1289 bytes} [Wed Aug 24 03:41:31 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/ips => generated 152 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:32.765736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:32.768752 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:32.809535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.810067 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.810525 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.811408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.811898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.812361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.912816 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4505cf55-fed3-4f17-b149-f8a2a41086f5 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153280 Aug 24 03:41:32.914291 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 462/918] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:32 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:32.925568 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:32.927058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:32.935229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.936135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.936860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.937829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.938536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.939216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.997047 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6df862f2-6613-4d50-89b6-09c4a5f88127 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/6a43dc68-5738-4438-a9b3-93368faf3278" status: 200 len: 194 microversion: 2.1 time: 0.074986 Aug 24 03:41:32.998517 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 457/919] 10.222.0.78 () {58 vars in 1413 bytes} [Wed Aug 24 03:41:32 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/6a43dc68-5738-4438-a9b3-93368faf3278 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:33.522866 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:33.523426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:33.531867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.532577 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.533244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:33.534273 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.534952 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.535677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:33.562208 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lazy-loading 'flavor' on Instance uuid be6880b5-1956-4d0a-b158-c65c6b7bd948 {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:33.567731 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:33.781036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-97b2ed1f-8895-4034-ac7c-afad302054e7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/action" status: 202 len: 0 microversion: 2.20 time: 0.264932 Aug 24 03:41:33.781811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 463/920] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 24 03:41:33 2022] POST /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:41:33.792446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:33.793502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:33.805038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.806532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.807438 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:33.808868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.809717 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.810629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:34.000273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:34.009813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:34.011880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:34.013847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b8bef3e7-4650-4616-b724-40c5f2a86b95 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.227370 Aug 24 03:41:34.014858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 458/921] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:33 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:34.623946 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "701d8ff5-50cd-4989-b32c-fdcfb72bbd06"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:34.631092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:34.646462 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:34.647203 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:34.647989 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:34.649389 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:34.650482 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:34.651491 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.042887 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:35.044815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:35.057899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.058771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.059848 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.060878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.062139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.062873 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.141570 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fa0f3f83-b5da-4eb4-92d8-4b250f54f0ed tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "POST /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527437 Aug 24 03:41:35.147561 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 464/922] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:41:34 2022] POST /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:35.356574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:35.373076 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:35.377105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:35.379430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-438cb803-6b40-43e3-aaff-2f9f9cd88a1f tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.344642 Aug 24 03:41:35.380467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 459/923] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:35 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:36.407303 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.408526 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:36.417549 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.418048 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.418501 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.419279 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.419741 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.420173 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.630789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.642639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.645147 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.647907 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7c8f3c20-68a5-4105-ad07-ee05899a6275 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.246467 Aug 24 03:41:36.648853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 465/924] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:37.548800 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.551764 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:37.560601 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.561226 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.561784 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.562992 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.563603 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.564128 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.605297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f0efb8e3-671c-4db5-abf7-7d101fa3e9b7 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063238 Aug 24 03:41:37.605944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 460/925] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:37.675978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.677180 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:37.688120 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.689127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.689949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.691431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.692328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.693113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.754991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.756841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:37.769074 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.770228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.770690 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.771786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.772356 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.772980 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.824301 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bddb5654-ba6d-4585-aa1f-80724b5a99c8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/6a43dc68-5738-4438-a9b3-93368faf3278" status: 200 len: 194 microversion: 2.1 time: 0.076029 Aug 24 03:41:37.825127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 461/926] 10.222.0.78 () {58 vars in 1413 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/6a43dc68-5738-4438-a9b3-93368faf3278 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:41:37.845156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.845933 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:37.857082 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.857803 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.858392 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.859941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.860943 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.861557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.981448 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.991035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lazy-loading 'services' on Instance uuid 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:37.993012 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.995997 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.998082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3e4f5f5c-c586-4d4e-84de-84a3dbb20146 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.329467 Aug 24 03:41:37.999152 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 466/927] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:38.089745 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-72136bb6-8037-400a-9a62-6f52fd95cdc9 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/6a43dc68-5738-4438-a9b3-93368faf3278" status: 202 len: 0 microversion: 2.1 time: 0.253101 Aug 24 03:41:38.090800 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 462/928] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:41:37 2022] DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/6a43dc68-5738-4438-a9b3-93368faf3278 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:41:39.022984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:39.023916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:39.031115 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:39.031661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:39.032137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:39.032990 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:39.033498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:39.034227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:39.214045 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:39.228451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:39.231302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:39.233441 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dcf470a4-4223-4487-beba-6be11583fd1e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.215050 Aug 24 03:41:39.234448 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 467/929] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:39 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:40.259048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:40.259755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:40.266639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.267158 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.267686 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.268478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.268981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.269511 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.384162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:40.384980 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:40.396174 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.396678 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.397410 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.398211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.398710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.399144 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.435102 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-86587614-559b-4e64-8ffe-e4f5e78227f8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/701d8ff5-50cd-4989-b32c-fdcfb72bbd06" status: 200 len: 194 microversion: 2.1 time: 0.059308 Aug 24 03:41:40.436077 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 468/930] 10.222.0.78 () {58 vars in 1413 bytes} [Wed Aug 24 03:41:40 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/701d8ff5-50cd-4989-b32c-fdcfb72bbd06 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:40.436839 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:40.452867 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:40.455444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:40.456065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:40.457149 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:40.458306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a3f15996-3837-4625-9dcb-0b5046bdd38c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.204143 Aug 24 03:41:40.459470 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 463/931] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:40 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:40.468154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.469031 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.469810 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.471143 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.472211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.472815 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.586728 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lazy-loading 'services' on Instance uuid 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:40.670943 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f8113471-7289-4f34-9638-4996758af16d tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/701d8ff5-50cd-4989-b32c-fdcfb72bbd06" status: 202 len: 0 microversion: 2.1 time: 0.222857 Aug 24 03:41:40.671552 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 469/932] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:41:40 2022] DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments/701d8ff5-50cd-4989-b32c-fdcfb72bbd06 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:41.503637 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:41.504602 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:41.517138 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:41.518689 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:41.519786 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:41.521173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:41.522052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:41.522896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:41.768823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.786221 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.788900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.791605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-46ca0c45-eb0d-4fc9-bb11-193a4238e7aa tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.296342 Aug 24 03:41:41.792672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 464/933] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:41 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:42.835016 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:42.836184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:42.847694 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.848348 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.848919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:42.849806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.850403 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.851028 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.057862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.064303 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.076323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.085095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.085903 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.086861 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.089406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.090355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.091776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.094382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.099269 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.113024 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d928c084-bf47-4a9b-860a-4f0c772917ac tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.275880 Aug 24 03:41:43.113024 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 470/934] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:42 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:43.155306 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9063796c-c61d-48f7-a243-2bcecd19edf4 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109627 Aug 24 03:41:43.155939 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 465/935] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:41:43.320771 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.323480 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.330455 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.331162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.331813 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.332332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.332797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.333444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.369094 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-76b62ea7-e1be-483c-8124-10f83c0a7d31 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052541 Aug 24 03:41:43.369721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 471/936] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:41:43.448457 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.448972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.456590 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.457114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.457547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.458329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.458845 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.459297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.490843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Going to try to terminate instance {{(pid=127258) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:41:43.599913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b26c3bb9-aeda-4618-9584-52ec9703dcaa tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 204 len: 0 microversion: 2.1 time: 0.155048 Aug 24 03:41:43.610878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 466/937] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:41:43 2022] DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:41:43.616200 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.617765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.625489 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.626209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.626824 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.627806 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.628407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.629022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.806401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.821631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-aa4d8816-3cdf-4a29-aac8-a86adcf86373 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1669 microversion: 2.1 time: 0.212271 Aug 24 03:41:43.822713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 472/938] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1669 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:44.136184 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:44.136912 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:44.145785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.146436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.146923 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.148043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.148554 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.149230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.300292 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.311876 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.313787 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.316376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d7123128-dd9f-46c6-9bc5-f2948d61d444 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.182789 Aug 24 03:41:44.316376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 467/939] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:44 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:44.844488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:44.845159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:44.852642 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.853134 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.853605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.854303 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.854790 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.855214 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:45.070147 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.082079 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0b095a82-01f2-40d0-ab74-16e8e5b9462b tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1669 microversion: 2.1 time: 0.241415 Aug 24 03:41:45.083071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 473/940] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:44 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:45.342897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:45.344008 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:45.354462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.355038 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.355480 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:45.356186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.356993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.357243 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:45.549477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.560085 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.561392 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.562703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d5b2a6f8-a3ba-4cf3-be52-ea6adb2e22f7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.227751 Aug 24 03:41:45.563317 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 468/941] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:45 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:46.115298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:46.116016 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:46.123610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.124107 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.124536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.125256 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.125919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.126117 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.328711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.340123 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d13d603e-9085-4146-99bc-0f330af9c9ba tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1669 microversion: 2.1 time: 0.228762 Aug 24 03:41:46.341132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 474/942] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:46 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1669 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:46.605270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:46.607588 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:46.627028 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.628765 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.629441 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.630792 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.631942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.632924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.839516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.855171 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.861002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.861002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-733221f0-e709-4f58-a508-1abcca2c83fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.260429 Aug 24 03:41:46.861002 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 469/943] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:46 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:47.367227 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:47.368363 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:47.383495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:47.384157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:47.384616 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:47.385416 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:47.385884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:47.386319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:47.472320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-d0321ded-2d9f-4c65-a473-9dbc30151919 req-432153a1-9c11-4556-8562-a22d2cae58c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a3ce71-d62f-4c9c-9458-35eed0f2cad2", "name": "network-vif-deleted", "tag": "dede27de-7357-424e-b33b-d2709f04ce10"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:47.492183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d0321ded-2d9f-4c65-a473-9dbc30151919 req-432153a1-9c11-4556-8562-a22d2cae58c6 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:47.493117 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d0321ded-2d9f-4c65-a473-9dbc30151919 req-432153a1-9c11-4556-8562-a22d2cae58c6 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:47.493744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-d0321ded-2d9f-4c65-a473-9dbc30151919 req-432153a1-9c11-4556-8562-a22d2cae58c6 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:47.501887 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1507cffe84dc4849a7040333ad48d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a745b184d3a462fae7c81ce668b01d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:47.503241 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:47.528206 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-36295fe5-ddb4-4691-9428-f6057045dc61 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 200 len: 1603 microversion: 2.1 time: 0.167642 Aug 24 03:41:47.529590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 475/944] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:47 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 1603 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:47.561207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-d0321ded-2d9f-4c65-a473-9dbc30151919 req-432153a1-9c11-4556-8562-a22d2cae58c6 service nova] Creating event network-vif-deleted:dede27de-7357-424e-b33b-d2709f04ce10 for instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 on hv-cinder-85426 Aug 24 03:41:47.584668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-d0321ded-2d9f-4c65-a473-9dbc30151919 req-432153a1-9c11-4556-8562-a22d2cae58c6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109878 Aug 24 03:41:47.586407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 470/945] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:47.901953 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:47.902966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:47.914207 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:47.915557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:47.916600 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:47.917934 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:47.918769 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:47.919529 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:47.956042 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:48.172264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:48.185436 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:48.187461 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:48.189020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d08d2bf7-f38c-4d9c-94f6-2f912cb3c6fe tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1745 microversion: 2.20 time: 0.293292 Aug 24 03:41:48.190331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 476/946] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:47 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1745 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:48.561642 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:48.563127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:48.573734 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:48.574838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:48.575865 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:48.577884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:48.578811 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:48.580207 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:48.619332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] HTTP exception thrown: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Request method failure captured: Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 HTTP/1.1 Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvgPX48w3Bm_JwaJ76DGuY8nAA3ihKvc65ySDtS4dNxUKI7TfztAznIZpjUOzqGugLDEMIa8-Vom-C1ZJq4yuYfhinWnqIpuixTaKivePyAy2vAOyug6ELa8HDnIrs3MDWrjIB0tfcDwEVoz9eRem-Ttd-GXL9xWkdKdKBWw0YJ6l8 Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:41:48.623376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8a745b184d3a462fae7c81ce668b01d2"}]}] Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 1507cffe84dc4849a7040333ad48d99c Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:48.624955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '40a3ce71-d62f-4c9c-9458-35eed0f2cad2'} Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:48.625981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:48.628629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:48.629984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Returning 404 to user: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:48.629984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ed641f15-bb2c-4333-89ad-9e4f1631f5c1 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 404 len: 111 microversion: 2.1 time: 0.080397 Aug 24 03:41:48.633451 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 471/947] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:48 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:48.643178 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b61c4a37-60a1-4bff-91b5-9217eb00e2a0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '.version_select at 0x7f4f442c33a0>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:48.673927 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b61c4a37-60a1-4bff-91b5-9217eb00e2a0 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569144878" status: 202 len: 0 microversion: 2.1 time: 0.037377 Aug 24 03:41:48.675898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 477/948] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 24 03:41:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569144878 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:49.231658 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:49.233595 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:49.248798 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.250033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.251196 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.252922 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.254283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.255100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.887623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.906853 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.911110 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.913465 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d379f4bd-6579-497c-a2ad-6ece78b1bcd8 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1745 microversion: 2.20 time: 0.688863 Aug 24 03:41:49.914547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 472/949] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:49 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1745 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:50.953057 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:50.953811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:50.963087 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:50.963596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:50.964043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:50.964879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:50.965340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:50.965770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:51.166849 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:51.176400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:51.178295 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:51.180081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-10bdc081-e3ac-4bca-a0ba-d7aeda00c1a9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1745 microversion: 2.20 time: 0.232853 Aug 24 03:41:51.181300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 478/950] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:50 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1745 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:52.206947 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:52.207621 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:52.214644 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.215176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.215609 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.216309 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.216761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.217179 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.386332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.396104 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.397641 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.398933 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f0204bb2-ee34-4d99-a6eb-ec6db59e45dc tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1745 microversion: 2.20 time: 0.196837 Aug 24 03:41:52.399519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 473/951] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:52 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:52.597782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:52.598435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:52.605821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.606462 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.607022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.607765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.608226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.608756 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.630635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-a66eef3b-9c23-4bf9-af8f-ae5646323a7f req-3dc29973-1d47-4626-88a8-1d7143056fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6880b5-1956-4d0a-b158-c65c6b7bd948", "name": "network-vif-plugged", "status": "completed", "tag": "07002f87-3795-4afe-ab6b-c223cea78539"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:52.630918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] HTTP exception thrown: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Request method failure captured: Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 HTTP/1.1 Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvgPX48w3Bm_JwaJ76DGuY8nAA3ihKvc65ySDtS4dNxUKI7TfztAznIZpjUOzqGugLDEMIa8-Vom-C1ZJq4yuYfhinWnqIpuixTaKivePyAy2vAOyug6ELa8HDnIrs3MDWrjIB0tfcDwEVoz9eRem-Ttd-GXL9xWkdKdKBWw0YJ6l8 Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:41:52.632557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8a745b184d3a462fae7c81ce668b01d2"}]}] Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 1507cffe84dc4849a7040333ad48d99c Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.633926 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '40a3ce71-d62f-4c9c-9458-35eed0f2cad2'} Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:52.634703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.635886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.637033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Returning 404 to user: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:52.637033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1e19f8b1-4dc2-4e93-931e-7d9187a3a573 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 404 len: 111 microversion: 2.1 time: 0.041237 Aug 24 03:41:52.639790 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 479/952] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:41:52 2022] DELETE /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:52.645671 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:52.646297 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 40a3ce71-d62f-4c9c-9458-35eed0f2cad2] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:52.648599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a66eef3b-9c23-4bf9-af8f-ae5646323a7f req-3dc29973-1d47-4626-88a8-1d7143056fda service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.649148 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a66eef3b-9c23-4bf9-af8f-ae5646323a7f req-3dc29973-1d47-4626-88a8-1d7143056fda service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.650066 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a66eef3b-9c23-4bf9-af8f-ae5646323a7f req-3dc29973-1d47-4626-88a8-1d7143056fda service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.654823 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.655561 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.656172 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.657068 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.657716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.658216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.664620 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-a66eef3b-9c23-4bf9-af8f-ae5646323a7f req-3dc29973-1d47-4626-88a8-1d7143056fda service nova] Creating event network-vif-plugged:07002f87-3795-4afe-ab6b-c223cea78539 for instance be6880b5-1956-4d0a-b158-c65c6b7bd948 on hv-cinder-85426 Aug 24 03:41:52.670639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-a66eef3b-9c23-4bf9-af8f-ae5646323a7f req-3dc29973-1d47-4626-88a8-1d7143056fda service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044273 Aug 24 03:41:52.671419 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 474/953] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:41:52.684362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] HTTP exception thrown: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Request method failure captured: Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 HTTP/1.1 Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvgPX48w3Bm_JwaJ76DGuY8nAA3ihKvc65ySDtS4dNxUKI7TfztAznIZpjUOzqGugLDEMIa8-Vom-C1ZJq4yuYfhinWnqIpuixTaKivePyAy2vAOyug6ELa8HDnIrs3MDWrjIB0tfcDwEVoz9eRem-Ttd-GXL9xWkdKdKBWw0YJ6l8 Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:41:52.687051 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8a745b184d3a462fae7c81ce668b01d2"}]}] Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 1507cffe84dc4849a7040333ad48d99c Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.688755 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '40a3ce71-d62f-4c9c-9458-35eed0f2cad2'} Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:52.689867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. Aug 24 03:41:52.691435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:52.692519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Returning 404 to user: Instance 40a3ce71-d62f-4c9c-9458-35eed0f2cad2 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:52.692519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c0121381-73a9-4088-a22f-3316ee3081cb tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2" status: 404 len: 111 microversion: 2.1 time: 0.047412 Aug 24 03:41:52.692519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 480/954] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:52 2022] GET /compute/v2.1/servers/40a3ce71-d62f-4c9c-9458-35eed0f2cad2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:53.441898 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:53.443126 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:53.453514 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.453957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.454778 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.456739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.457527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.458245 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.642202 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.654900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.656754 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.658125 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1440692b-0ee4-42bf-8111-73b1b8b10f0c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.224461 Aug 24 03:41:53.659472 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 475/955] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:53 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:53.878059 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:53.879078 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:53.887521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.888225 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.888918 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.889657 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.890208 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.890693 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.907337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] HTTP exception thrown: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Request method failure captured: Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d HTTP/1.1 Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvgPX48w3Bm_JwaJ76DGuY8nAA3ihKvc65ySDtS4dNxUKI7TfztAznIZpjUOzqGugLDEMIa8-Vom-C1ZJq4yuYfhinWnqIpuixTaKivePyAy2vAOyug6ELa8HDnIrs3MDWrjIB0tfcDwEVoz9eRem-Ttd-GXL9xWkdKdKBWw0YJ6l8 Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:41:53.909074 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8a745b184d3a462fae7c81ce668b01d2"}]}] Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 1507cffe84dc4849a7040333ad48d99c Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:53.912151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '6d705a9b-3c26-4e94-b89e-a23a4c38320d'} Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:53.914812 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:53.917344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:41:53.929517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Returning 404 to user: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:53.929517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-2583d0c5-e538-496b-b3a8-dc52ead02a38 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 404 len: 111 microversion: 2.1 time: 0.037650 Aug 24 03:41:53.929517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 481/956] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:41:53 2022] DELETE /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:41:53.939310 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:53.944862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] [instance: 6d705a9b-3c26-4e94-b89e-a23a4c38320d] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:53.963208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.965192 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.966012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.967297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.968127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.969016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.006558 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] HTTP exception thrown: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Request method failure captured: Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d HTTP/1.1 Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvgPX48w3Bm_JwaJ76DGuY8nAA3ihKvc65ySDtS4dNxUKI7TfztAznIZpjUOzqGugLDEMIa8-Vom-C1ZJq4yuYfhinWnqIpuixTaKivePyAy2vAOyug6ELa8HDnIrs3MDWrjIB0tfcDwEVoz9eRem-Ttd-GXL9xWkdKdKBWw0YJ6l8 Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:41:54.017525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8a745b184d3a462fae7c81ce668b01d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8a745b184d3a462fae7c81ce668b01d2"}]}] Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 8a745b184d3a462fae7c81ce668b01d2 Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2062794139 Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 1507cffe84dc4849a7040333ad48d99c Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeTestJSON-2062794139-project Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:54.019209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '6d705a9b-3c26-4e94-b89e-a23a4c38320d'} Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:54.020095 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. Aug 24 03:41:54.021426 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:41:54.022582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] Returning 404 to user: Instance 6d705a9b-3c26-4e94-b89e-a23a4c38320d could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:54.022582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f3ae868f-1dbb-43e9-89cc-e4aa212ce9a8 tempest-AttachVolumeTestJSON-2062794139 tempest-AttachVolumeTestJSON-2062794139-project] 10.222.0.78 "GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d" status: 404 len: 111 microversion: 2.1 time: 0.096200 Aug 24 03:41:54.022582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 476/957] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:53 2022] GET /compute/v2.1/servers/6d705a9b-3c26-4e94-b89e-a23a4c38320d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:54.686541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:54.688162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:54.701108 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.701977 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.702718 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.703871 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.704648 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.705347 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.021293 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.053651 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.058151 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.061323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e522a8f7-e9cc-4fc6-af4a-64760cd39213 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.381727 Aug 24 03:41:55.063624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 482/958] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:54 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:56.101875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.103133 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:56.116965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.117880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.118631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.119569 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.120209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.120970 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.588018 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.600391 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.604919 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.607507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-603ab76a-995a-46c5-9d29-e16cf3f72ede tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.510363 Aug 24 03:41:56.608100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 477/959] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:56 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:57.655609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:57.657767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:57.671475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.672694 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.674715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.676465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.678884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.679998 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.929105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.952137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.955627 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.959496 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-327b36ae-e405-41a0-bdf2-4d82ce78ccf4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.311743 Aug 24 03:41:57.960753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 483/960] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:57 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:58.994433 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:59.004304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:59.028479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:59.037582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.038215 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.038753 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.039482 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.040093 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.040553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.453121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.519298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.524352 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.527986 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cfcd8419-7bf9-4a8a-a8f4-10e17d5a09ce tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.544078 Aug 24 03:41:59.546445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 478/961] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:00.577968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:00.580210 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:00.604991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:00.618702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.620039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.621099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.623275 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.624439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.625444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.964968 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.994959 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.997624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:01.000562 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4fcf9718-67f5-44cd-b2bc-94c6c3b7094a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.430574 Aug 24 03:42:01.014435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 484/962] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:00 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:02.055336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.056489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.072976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.073479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.073917 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.074696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.076683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.076683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.352761 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.381458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.387284 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.390072 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-9d52211c-8f28-42b6-8d5a-6124e17b47c2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.339360 Aug 24 03:42:02.393395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 479/963] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:02 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:03.416821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.418147 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.428805 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.429659 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.430358 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.431566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.432193 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.432801 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.731369 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.742401 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.744306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.745677 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ead8070c-90e0-43c6-b05d-530b9556d77d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.332801 Aug 24 03:42:03.746263 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 485/964] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:03 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:04.786278 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:04.787771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:04.795692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.796620 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.797354 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.798355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.799535 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.800072 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.992264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.006077 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.009189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.011886 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-de1b0014-2e7b-4cf4-991f-89856dbfdbea tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.229608 Aug 24 03:42:05.013201 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 480/965] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:04 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:06.039777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:06.040789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:06.060583 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.062072 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.064248 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.066168 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.067060 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.068631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.315881 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.355430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.364092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.370088 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-006a58cd-2681-4763-8cce-970d9963e748 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.336503 Aug 24 03:42:06.374789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 486/966] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:06 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:07.424825 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:07.425624 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:07.438380 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.439068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.439780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.440862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.441519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.442208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.688464 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.705532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.708813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.711425 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b82bc577-488e-4c5b-a065-b7b43b775267 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1740 microversion: 2.20 time: 0.292941 Aug 24 03:42:07.712466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 481/967] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:07 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:08.738220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:08.739065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:08.749845 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.750774 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.751541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.753679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.754492 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.755256 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.966577 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:08.981137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:08.983944 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:08.985610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b6ff6ceb-8c00-4cec-baac-f980162038af tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1722 microversion: 2.20 time: 0.252602 Aug 24 03:42:08.986475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 487/968] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:08 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:10.022135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:10.022949 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:10.029844 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.030345 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.030821 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.031547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.032021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.032455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.238645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.249531 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.251959 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.253622 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-845896cd-8fbf-4419-a722-1ba02ff888e2 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1722 microversion: 2.20 time: 0.235846 Aug 24 03:42:10.254369 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 482/969] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:10 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:11.292853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:11.294218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:11.305230 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.306360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.307274 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.308251 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.308856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.309384 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.563497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.582874 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.586102 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.594054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4bd9253e-0925-4351-8192-1a5f1f0d3d2a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1722 microversion: 2.20 time: 0.305941 Aug 24 03:42:11.602158 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 488/970] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:11 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:12.629359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:12.630521 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:12.644681 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:12.645620 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:12.646760 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:12.648401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:12.649692 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:12.650797 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:12.726504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-c6c3e7d2-d056-450f-b0c6-ce8a30356ea3 req-7dbce7f3-848c-444c-9b02-26a4d47c2e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6880b5-1956-4d0a-b158-c65c6b7bd948", "name": "network-vif-unplugged", "status": "completed", "tag": "07002f87-3795-4afe-ab6b-c223cea78539"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:12.739415 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c6c3e7d2-d056-450f-b0c6-ce8a30356ea3 req-7dbce7f3-848c-444c-9b02-26a4d47c2e3b service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:12.739929 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c6c3e7d2-d056-450f-b0c6-ce8a30356ea3 req-7dbce7f3-848c-444c-9b02-26a4d47c2e3b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:12.740362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-c6c3e7d2-d056-450f-b0c6-ce8a30356ea3 req-7dbce7f3-848c-444c-9b02-26a4d47c2e3b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:12.764343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.compute.server_external_events [req-c6c3e7d2-d056-450f-b0c6-ce8a30356ea3 req-7dbce7f3-848c-444c-9b02-26a4d47c2e3b service nova] Unable to find a host for instance be6880b5-1956-4d0a-b158-c65c6b7bd948. Dropping event network-vif-unplugged {{(pid=127257) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:42:12.765852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-c6c3e7d2-d056-450f-b0c6-ce8a30356ea3 req-7dbce7f3-848c-444c-9b02-26a4d47c2e3b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046942 Aug 24 03:42:12.768817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 489/971] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 03:42:12.926748 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:12.950363 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:12.955090 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:12.957984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-fcb524d9-ec59-4b96-96c8-c0f5647479d3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1665 microversion: 2.20 time: 0.338238 Aug 24 03:42:12.967049 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 483/972] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:12 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1665 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:12.998578 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19e94cf5-8558-4d5f-844b-06a1aba4be1d"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:13.002025 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:13.013591 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.014137 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.014578 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.015719 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.016043 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.016916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.443011 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-91cf9c79-5438-4a53-94b0-a9132eef3599 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.450183 Aug 24 03:42:13.443747 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 490/973] 10.222.0.78 () {62 vars in 1364 bytes} [Wed Aug 24 03:42:12 2022] POST /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-volume_attachments => generated 188 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:42:13.662063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:13.662978 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:13.674396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.675283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.676062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.677401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.678228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.679037 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.145414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f06fbcd3-f0c4-4086-8721-02db4f307430 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-volume_attachments/19e94cf5-8558-4d5f-844b-06a1aba4be1d" status: 202 len: 0 microversion: 2.20 time: 0.493003 Aug 24 03:42:14.146526 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 484/974] 10.222.0.78 () {60 vars in 1457 bytes} [Wed Aug 24 03:42:13 2022] DELETE /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-volume_attachments/19e94cf5-8558-4d5f-844b-06a1aba4be1d => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:42:14.236447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:14.237604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:14.250453 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.251477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.252285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.254306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.255188 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.255961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.322026 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127257) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:42:14.456354 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8f806ef6-0c91-4c2b-8c2a-2c42ed1265c0 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "POST /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/action" status: 202 len: 0 microversion: 2.20 time: 0.227537 Aug 24 03:42:14.457599 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 491/975] 10.222.0.78 () {62 vars in 1319 bytes} [Wed Aug 24 03:42:14 2022] POST /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:42:14.469153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:14.469936 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:14.491599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.492153 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.492649 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.493669 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.495135 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.495669 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.717273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.734516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.739743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.742477 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b5c77b73-29a8-4d2e-b67e-6168052d5c8a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1673 microversion: 2.20 time: 0.278435 Aug 24 03:42:14.759131 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 485/976] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:14 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1673 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:15.788611 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.789494 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.801970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.803381 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.805105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.807034 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.809818 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.810589 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.049681 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.061292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.063279 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.064945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f60700ab-a6dc-4c6e-ba2a-73d4b29635f6 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1673 microversion: 2.20 time: 0.290015 Aug 24 03:42:16.065535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 492/977] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:15 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1673 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:16.391839 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-14572903", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452", "networks": [{"uuid": "b7ad55dd-a363-4b51-b7ca-e9796ebe8b1d"}]}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:16.457144 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] validate_networks() for [('b7ad55dd-a363-4b51-b7ca-e9796ebe8b1d', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:42:16.956291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:42:16.956823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:42:16.957889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:42:16.958577 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:42:16.959276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:42:16.974724 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.975560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.976289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.977634 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.978459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.979275 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.008062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Getting quotas for project 097359f0dcfd4d289f56c08aaa025fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:42:17.014541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Getting quotas for user 01a1bb68c2294c6fb7806abf7349bd56 and project 097359f0dcfd4d289f56c08aaa025fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:42:17.034545 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:42:17.038953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:42:17.101105 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:17.111193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8ece7cef-cfc1-4d6e-9769-036ca3b94f76 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797617 Aug 24 03:42:17.112213 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 486/978] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:42:17.115770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:17.124588 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2b7f0c83-0a34-4740-84d6-90a42e56240e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:17.125204 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2b7f0c83-0a34-4740-84d6-90a42e56240e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:17.136189 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.137558 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.138433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.140154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.143807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.145933 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.156201 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:17.207896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2b7f0c83-0a34-4740-84d6-90a42e56240e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.220327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2b7f0c83-0a34-4740-84d6-90a42e56240e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1212 microversion: 2.1 time: 0.100125 Aug 24 03:42:17.221189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 487/979] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:17 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:17.369851 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.385054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.388222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.390233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8b812a78-185b-478f-bd5b-5452da9d53a5 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1673 microversion: 2.20 time: 0.299567 Aug 24 03:42:17.391167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 493/980] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:17 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1673 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:18.246279 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:18.247327 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:18.258242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.258242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.258791 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.259894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.260621 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.261364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.290302 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:18.344854 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.356369 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b5c42cb7-358a-4be6-bdc6-2ada6f7b8ced tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1264 microversion: 2.1 time: 0.115087 Aug 24 03:42:18.356966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 488/981] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:18 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1264 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:18.435917 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:18.437470 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:18.448930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.449771 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.450426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.451661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.452587 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.460134 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.752817 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.769171 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.772315 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.775283 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8f52abc4-4730-409c-8cbe-202ec925b067 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1673 microversion: 2.20 time: 0.347015 Aug 24 03:42:18.776660 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 494/982] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:18 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1673 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:19.395194 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:19.396432 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:19.408653 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.409574 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.410371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:19.411779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.412620 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.413639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:19.628801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.649965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ca1a182f-f818-413c-a2f2-f68d0a45eb81 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.260669 Aug 24 03:42:19.650801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 489/983] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:19 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:19.806635 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:19.807886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:19.821310 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.822292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.823340 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:19.824646 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.825487 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.826219 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.091538 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.104250 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.106032 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.107776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-3ad2055e-504d-4d92-b18a-56518ec0228a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1673 microversion: 2.20 time: 0.309972 Aug 24 03:42:20.108563 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 495/984] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:19 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1673 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:20.687507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:20.688268 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:20.697370 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:20.698379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:20.699005 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.700129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:20.700857 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:20.701596 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.799703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-1a1bb190-78d4-4596-a76e-e0105c6e57bf req-67317010-237b-4cf0-a7c2-1dc23a8c9e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29ee817-8013-43f1-a723-7da10144e24c", "tag": "da4cedc0-992b-41b6-b8fa-e24eaafba4a0"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:20.821063 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-1a1bb190-78d4-4596-a76e-e0105c6e57bf req-67317010-237b-4cf0-a7c2-1dc23a8c9e06 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:20.823124 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-1a1bb190-78d4-4596-a76e-e0105c6e57bf req-67317010-237b-4cf0-a7c2-1dc23a8c9e06 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:20.824243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-1a1bb190-78d4-4596-a76e-e0105c6e57bf req-67317010-237b-4cf0-a7c2-1dc23a8c9e06 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.846938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-1a1bb190-78d4-4596-a76e-e0105c6e57bf req-67317010-237b-4cf0-a7c2-1dc23a8c9e06 service nova] Creating event network-changed:da4cedc0-992b-41b6-b8fa-e24eaafba4a0 for instance e29ee817-8013-43f1-a723-7da10144e24c on hv-cinder-85426 Aug 24 03:42:20.874935 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-1a1bb190-78d4-4596-a76e-e0105c6e57bf req-67317010-237b-4cf0-a7c2-1dc23a8c9e06 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065717 Aug 24 03:42:20.876723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 496/985] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:20.883541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.897098 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-30982398-2a46-421f-8c28-b6310e50d9fe tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.213397 Aug 24 03:42:20.898127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 490/986] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:20 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:21.147165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:21.149351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:21.161141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.162021 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.163054 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.164784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.165879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.166624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.419896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.442234 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.445630 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.448033 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c734f0b2-9af7-4de2-bb94-8ec013030d5c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.307171 Aug 24 03:42:21.449166 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 497/987] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:21 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:21.925223 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:21.926676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:21.939021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.939913 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.940727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.942086 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.942993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.943747 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.165345 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.175710 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-25a8b5f6-209d-47ba-894f-f9f2f007396a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.257890 Aug 24 03:42:22.176559 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 491/988] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:21 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:22.492550 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:22.493316 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:22.502507 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.503217 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.503716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.504584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.505302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.506351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.690740 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.702477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.704424 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.706684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e539d751-acc9-483d-81f4-9ddea0fe753a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.218660 Aug 24 03:42:22.713402 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 498/989] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:22 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:23.199462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:23.200481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:23.209548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.209882 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.210290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.211066 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.211525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.211957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.390406 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.400901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3b76f2ec-d3ca-46aa-92e6-3fc3d7f59deb tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.206382 Aug 24 03:42:23.401698 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 492/990] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:23 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:23.737789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:23.738781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:23.748056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.748729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.749221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.750124 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.750694 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.751254 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.952315 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.968220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.971055 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.972473 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-977fc542-7683-454e-abaa-825c8c4913a7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.240765 Aug 24 03:42:23.973655 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 499/991] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:23 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:24.428551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:24.429665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:24.439857 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.440355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.440795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.441509 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.441967 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.442395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.601146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.612139 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8a6d1abe-1910-41e2-abe2-93fbd1faf574 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.191460 Aug 24 03:42:24.612779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 493/992] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:24 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:25.000598 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:25.001882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:25.012028 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.012840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.013765 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.014815 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.015509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.015979 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.238949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.252937 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.255978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.258038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-45e45353-da13-4e5f-bdd3-be95778de813 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.263268 Aug 24 03:42:25.259101 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 500/993] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:24 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:25.654987 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:25.658733 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:25.678157 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.679507 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.681094 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.682751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.683795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.684945 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.973398 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.994069 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bd8a3e94-0231-4cce-ac35-c9ff37be2bc5 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.349609 Aug 24 03:42:25.995728 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 494/994] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:25 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:26.286842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:26.289214 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:26.301961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.302914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.303773 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.304631 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.305496 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.306090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.514866 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.525836 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.527915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.529393 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-64eedb43-d28f-47c5-90a6-8659fe3e2fd7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.250371 Aug 24 03:42:26.530737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 501/995] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:26 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:27.019575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:27.027297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:27.038263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:27.053428 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.053911 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.071909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.073497 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.074631 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.075888 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.226696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=8 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:27.317019 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.330552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-ff24e0b1-641e-40e3-a44b-e7e57ac55a87 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.315493 Aug 24 03:42:27.332577 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 495/996] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:27 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:27.562070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:27.563233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:27.577047 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.578348 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.580882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.583216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.584529 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.585613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.951556 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.971015 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.973232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.975463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-23c689e5-47d7-4d34-a8a4-800dccf3657b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.422369 Aug 24 03:42:27.977996 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 502/997] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:27 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:28.371593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:28.374431 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:28.392722 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.393709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.394488 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.395910 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.396832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.397660 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.596891 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.611487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-aff04d74-c66a-4e8e-aa13-5a57798a2078 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.248667 Aug 24 03:42:28.629407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 496/998] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:28 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:29.005852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-20a93818-b907-4568-9276-577b82dabf45 req-bf1ec17b-cb8d-49ee-8539-a6824d7a82ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29ee817-8013-43f1-a723-7da10144e24c", "name": "network-vif-plugged", "status": "completed", "tag": "da4cedc0-992b-41b6-b8fa-e24eaafba4a0"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:29.023714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.025390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.052757 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.059295 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.060463 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.061685 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-20a93818-b907-4568-9276-577b82dabf45 req-bf1ec17b-cb8d-49ee-8539-a6824d7a82ac service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.066349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-20a93818-b907-4568-9276-577b82dabf45 req-bf1ec17b-cb8d-49ee-8539-a6824d7a82ac service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.068540 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.073115 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.073931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.075266 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-20a93818-b907-4568-9276-577b82dabf45 req-bf1ec17b-cb8d-49ee-8539-a6824d7a82ac service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.126994 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-20a93818-b907-4568-9276-577b82dabf45 req-bf1ec17b-cb8d-49ee-8539-a6824d7a82ac service nova] Creating event network-vif-plugged:da4cedc0-992b-41b6-b8fa-e24eaafba4a0 for instance e29ee817-8013-43f1-a723-7da10144e24c on hv-cinder-85426 Aug 24 03:42:29.138404 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-20a93818-b907-4568-9276-577b82dabf45 req-bf1ec17b-cb8d-49ee-8539-a6824d7a82ac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145059 Aug 24 03:42:29.139785 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 503/999] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:29.464894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.479884 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.481743 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.483288 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-791fb37b-3001-4f98-8d28-52bebc17a4c7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.471318 Aug 24 03:42:29.484390 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 497/1000] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:29.655518 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.656747 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.667526 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.668291 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.669170 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.670309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.671017 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.671463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.855083 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.867537 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7fecb7b3-7bcc-42a8-9103-742dc845dd31 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.220973 Aug 24 03:42:29.868132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 504/1001] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:30.509795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:30.510936 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.514031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:30.522233 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.522938 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.523528 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.525278 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.525993 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.526578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.780547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.792031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.794741 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.796703 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-19d5ec3b-3280-4bd2-9bd3-71fd1f58ae18 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.292379 Aug 24 03:42:30.798033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 498/1002] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:30 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:30.904388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:30.905521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.911444 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:30.920895 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.921744 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.922477 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.923798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.924886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.925841 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.204628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.219746 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-45141b4b-28ec-4ac9-aa39-70e1b9921c41 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.321969 Aug 24 03:42:31.220760 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 505/1003] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:30 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:31.851146 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:31.853284 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:31.867586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.868830 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.869840 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.871815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.872918 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.873945 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.108437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.119553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.122270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.123832 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7a092040-77a1-4dbe-b3b5-84203e28fdd4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.279359 Aug 24 03:42:32.127949 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 499/1004] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:31 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:32.243795 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:32.245935 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:32.256141 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.258586 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.259530 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.260672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.262146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.262955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.482480 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.506309 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7c53c4be-3b4c-402e-84f4-da1db2532d9d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.267672 Aug 24 03:42:32.535542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 506/1005] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:32 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:33.154562 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:33.156032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:33.185129 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.185963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.186708 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.187939 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.188965 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.189701 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.396907 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.411349 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.412907 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.414199 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0afc1fe9-b082-4f9f-b6bd-a9607decef4c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.269924 Aug 24 03:42:33.414877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 500/1006] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:33 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:33.547696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:33.549184 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:33.556545 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.557332 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.557861 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.558828 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.559561 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.560048 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.816175 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.837467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-493775d9-40a1-402b-ab6b-39d56fb4facf tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.293495 Aug 24 03:42:33.838300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 507/1007] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:33 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:34.443147 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:34.443880 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:34.451851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.452361 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.452809 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.454014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.454763 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.455400 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.861412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:34.862435 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:34.871548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.872192 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.872743 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.873831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.874604 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.875462 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.051044 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.072843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.075981 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.078143 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-107a168f-e189-4c6f-a28d-972cc202a2b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.640708 Aug 24 03:42:35.079396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 501/1008] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:34 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:35.342921 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.365967 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-44529def-de37-4ccc-8b0c-5884c7b4d91e tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.509240 Aug 24 03:42:35.367628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 508/1009] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:34 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:36.110280 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:36.111338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:36.122445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.123354 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.124140 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.125421 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.127041 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.127304 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.365308 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.375169 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.377705 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.379012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-026bb39e-cdf1-4a47-b89f-36b4d7418708 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.273688 Aug 24 03:42:36.379635 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 502/1010] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:36 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:36.401127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:36.402814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:36.413726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.414488 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.415136 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.416149 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.416924 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.417467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.646508 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.659526 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-0a56e8bc-a807-4259-ae8a-e00dde3f6f15 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.263247 Aug 24 03:42:36.660447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 509/1011] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:36 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:37.419785 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:37.421029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:37.434117 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.435055 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.435973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.437247 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.438168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.439006 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.649410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.666384 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.669605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.671942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-944a0e5c-1ab9-4123-aeb3-ff6ad1aa7fa7 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.260834 Aug 24 03:42:37.673810 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 503/1012] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:37 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:37.696248 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:37.699346 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:37.709668 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.710182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.710640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.711408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.711878 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.712334 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.924782 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.948876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f7365421-0704-4e0f-8818-6a7852258b06 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.261346 Aug 24 03:42:37.949541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 510/1013] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:37 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:38.716307 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:38.717776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:38.730292 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.731242 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:38.732061 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.733407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.734246 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:38.735154 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.983344 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.989915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:38.992427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:39.000706 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.004396 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.007189 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2880bbcd-2a70-47bb-9499-84cf19436103 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.297177 Aug 24 03:42:39.007873 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.008556 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 504/1014] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:38 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:39.009857 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.010882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.012734 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.013748 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.014721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.026475 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=100 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:39.268643 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.283223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-95b358a9-086e-4dfd-acc5-888ef99ad01c tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.303629 Aug 24 03:42:39.284277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 511/1015] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:38 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:40.039758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:40.040721 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:40.052466 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.053219 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.053942 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.055496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.056266 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.056966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.064725 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=100 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:40.301762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.309832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:40.311201 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:40.317431 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.320410 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.322459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-455aad52-ca6d-4542-9c9b-39c18a07632e tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.289874 Aug 24 03:42:40.323591 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 505/1016] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:40.323784 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.324627 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.325509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.326703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.327512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.328213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.635960 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.666936 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-226b320a-29f6-49a6-9d26-30604124808a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.362622 Aug 24 03:42:40.679142 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 512/1017] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:41.363893 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.366298 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:41.378403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.378932 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.379373 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.380079 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.380740 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.381418 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.603901 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:41.618580 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:41.621318 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:41.623821 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2d5f4a3e-f30e-4427-938a-157599dc032a tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.267467 Aug 24 03:42:41.624782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 506/1018] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:41.722274 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.723426 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:41.737388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.737388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.737388 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.738455 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.739325 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.740081 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.963182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:41.981497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-36ff363a-951e-4bd6-a693-afc6e7ece37d tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.265779 Aug 24 03:42:41.983595 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 513/1019] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:42.662089 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:42.663187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:42.673944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:42.674878 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:42.675658 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.676851 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:42.677611 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:42.678348 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.928393 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.944527 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.947556 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.949716 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-54794e48-392a-462b-a614-c4804b91c9f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.295134 Aug 24 03:42:42.950728 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 507/1020] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:42 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:43.019130 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:43.020215 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:43.032440 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.033264 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.033978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.035206 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.036398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.037446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.305617 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.335555 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c9d16768-0ec0-4d18-84e8-0d3e9b3d08a9 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1312 microversion: 2.1 time: 0.323396 Aug 24 03:42:43.337128 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 514/1021] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:43 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:43.992286 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:43.993394 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:44.006383 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.007279 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.008065 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.009347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.010254 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.010989 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.303664 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.326290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.329615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.331299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-188f71c2-865f-42ae-9f3b-2a017674e636 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.346748 Aug 24 03:42:44.331903 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 508/1022] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:43 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:44.381872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:44.383589 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:44.393525 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.394031 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.394467 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.395413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.395877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.396305 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.637585 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.651326 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d9c5d169-9f5e-4857-ac21-743c0ab622ce tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1496 microversion: 2.1 time: 0.275408 Aug 24 03:42:44.652326 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 515/1023] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:44 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:45.059532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-8effcad5-d12b-45be-b7e4-0c3a12d9b7a1 req-6c835a25-0f34-48be-af50-376d8d82bb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6880b5-1956-4d0a-b158-c65c6b7bd948", "name": "network-vif-plugged", "status": "completed", "tag": "07002f87-3795-4afe-ab6b-c223cea78539"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:45.077058 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-8effcad5-d12b-45be-b7e4-0c3a12d9b7a1 req-6c835a25-0f34-48be-af50-376d8d82bb9b service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.078868 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-8effcad5-d12b-45be-b7e4-0c3a12d9b7a1 req-6c835a25-0f34-48be-af50-376d8d82bb9b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.079611 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-8effcad5-d12b-45be-b7e4-0c3a12d9b7a1 req-6c835a25-0f34-48be-af50-376d8d82bb9b service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.102450 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-8effcad5-d12b-45be-b7e4-0c3a12d9b7a1 req-6c835a25-0f34-48be-af50-376d8d82bb9b service nova] Creating event network-vif-plugged:07002f87-3795-4afe-ab6b-c223cea78539 for instance be6880b5-1956-4d0a-b158-c65c6b7bd948 on hv-cinder-85426 Aug 24 03:42:45.113105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-8effcad5-d12b-45be-b7e4-0c3a12d9b7a1 req-6c835a25-0f34-48be-af50-376d8d82bb9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059084 Aug 24 03:42:45.114042 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 509/1024] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:45.371644 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.372672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:45.383635 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.384628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.385213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.386486 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.387361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.388171 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.650353 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.664437 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.667040 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.668852 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ef2a9082-e6df-4470-aa6a-f3d4beada2f9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.304281 Aug 24 03:42:45.669738 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 516/1025] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:45 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:46.315299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:46.316347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:46.328630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.329491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.330265 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.331564 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.332372 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.333417 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.380722 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3576b52a-9c4f-4cd3-aff7-1f4485f4075e tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/ips" status: 200 len: 150 microversion: 2.1 time: 0.072992 Aug 24 03:42:46.381909 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 510/1026] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:42:46 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/ips => generated 150 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:46.706948 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:46.709562 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:46.724800 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.726262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.727328 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.728851 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.729936 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.730984 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:47.013209 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.027723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.030405 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.032640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-76e8b460-0813-4ad1-94ad-946ec310f9eb tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.333701 Aug 24 03:42:47.033515 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 517/1027] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:46 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:48.004412 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "017cdd8e-930b-4a5f-b77f-84d4e5d834fb"}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:48.008421 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:48.019563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.020295 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.020948 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.022025 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.023053 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.023599 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.079509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:48.080754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:48.092730 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.094095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.094990 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.099000 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.100020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.100771 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.369781 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:48.384541 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:48.387602 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:48.389524 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-a19b82f7-ef72-4d6e-8822-a8275be9b8d9 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1731 microversion: 2.20 time: 0.321953 Aug 24 03:42:48.390537 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 518/1028] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:48 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1731 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:48.399319 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:48.400451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:48.411354 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.412465 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.413375 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.415723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.416720 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.417606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.466436 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:42:48.551168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-88dcbada-8346-4676-be03-ec1a69f3d2d4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "POST /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557000 Aug 24 03:42:48.558776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 511/1029] 10.222.0.78 () {60 vars in 1323 bytes} [Wed Aug 24 03:42:47 2022] POST /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:48.592535 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-50b9c4f2-f0be-4eb2-9ad2-ba300d495529 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 204 len: 0 microversion: 2.1 time: 0.199339 Aug 24 03:42:48.594150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 519/1030] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:48 2022] DELETE /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:42:48.619879 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:48.621434 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:48.645249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.646536 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.647578 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.649481 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.651836 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.653097 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.887899 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:48.900580 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8a0698c1-ada5-4379-9158-e46350f9f4b3 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1502 microversion: 2.1 time: 0.294848 Aug 24 03:42:48.901479 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 512/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:48 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1502 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:49.428702 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:49.429772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:49.440908 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.441662 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.442329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.443454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.444199 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.444853 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.687851 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.701902 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.704732 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.706811 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9d9b644f-e8fb-4bf6-8d5f-afe4f4b3100b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1718 microversion: 2.20 time: 0.285671 Aug 24 03:42:49.707693 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 520/1032] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:49 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1718 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:49.935435 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:49.936547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:49.948540 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.949403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.950168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.951488 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.952285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.953033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.203454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.218829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-62de2ca8-4a3c-4e55-ab99-5bc1b4de1bd8 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1502 microversion: 2.1 time: 0.290562 Aug 24 03:42:50.220089 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 513/1033] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:49 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:51.258323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.259454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.271807 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.272798 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.273630 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.275069 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.275915 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.276696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.549272 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:51.566002 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-187f3023-e19e-46f6-b63c-c4f463641331 tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1502 microversion: 2.1 time: 0.314417 Aug 24 03:42:51.579799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 521/1034] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:51 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:52.098864 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-7daf0a7f-abd7-4b3a-847d-3b2a8117a52e req-6edd78f8-39c3-46e3-904d-939b45d9ea4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29ee817-8013-43f1-a723-7da10144e24c", "name": "network-vif-deleted", "tag": "da4cedc0-992b-41b6-b8fa-e24eaafba4a0"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:52.117198 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7daf0a7f-abd7-4b3a-847d-3b2a8117a52e req-6edd78f8-39c3-46e3-904d-939b45d9ea4e service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.118090 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7daf0a7f-abd7-4b3a-847d-3b2a8117a52e req-6edd78f8-39c3-46e3-904d-939b45d9ea4e service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.118940 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7daf0a7f-abd7-4b3a-847d-3b2a8117a52e req-6edd78f8-39c3-46e3-904d-939b45d9ea4e service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.142162 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-7daf0a7f-abd7-4b3a-847d-3b2a8117a52e req-6edd78f8-39c3-46e3-904d-939b45d9ea4e service nova] Creating event network-vif-deleted:da4cedc0-992b-41b6-b8fa-e24eaafba4a0 for instance e29ee817-8013-43f1-a723-7da10144e24c on hv-cinder-85426 Aug 24 03:42:52.151124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-7daf0a7f-abd7-4b3a-847d-3b2a8117a52e req-6edd78f8-39c3-46e3-904d-939b45d9ea4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058945 Aug 24 03:42:52.152240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 514/1035] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:52.332423 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:52.333216 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:52.344496 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.345367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.346133 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.347446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.348257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.349008 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.488532 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lazy-loading 'services' on Instance uuid 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:42:52.596038 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4b29963e-6b16-4355-9171-4db4a39b0704 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments/017cdd8e-930b-4a5f-b77f-84d4e5d834fb" status: 202 len: 0 microversion: 2.1 time: 0.267551 Aug 24 03:42:52.602274 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 522/1036] 10.222.0.78 () {58 vars in 1416 bytes} [Wed Aug 24 03:42:52 2022] DELETE /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments/017cdd8e-930b-4a5f-b77f-84d4e5d834fb => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:42:52.605955 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:52.608823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:52.621257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.622422 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.623454 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.624927 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.625902 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.626838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.629652 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:52.635669 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:52.648937 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.650276 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.651424 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.652966 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.653813 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.654699 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.686645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.687487 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.689422 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.690518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lazy-loading 'fault' on Instance uuid e29ee817-8013-43f1-a723-7da10144e24c {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:42:52.725391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7bfb99c7-9ac8-47e8-a140-7b05997aacc9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120408 Aug 24 03:42:52.726220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 523/1037] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:42:52 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:52.776107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a1bb68c2294c6fb7806abf7349bd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097359f0dcfd4d289f56c08aaa025fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.800894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3d8003b7-12ab-444b-8ee0-2cd0aa0fcd3a tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 200 len: 1302 microversion: 2.1 time: 0.201525 Aug 24 03:42:52.803124 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 515/1038] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:52 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 1302 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:53.745182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:53.748592 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:53.758495 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.759295 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.759940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.761003 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.761730 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.762365 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.801323 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-897afbe1-1b79-4699-baca-2edba63bf3ff tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062613 Aug 24 03:42:53.802237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 524/1039] 10.222.0.78 () {58 vars in 1302 bytes} [Wed Aug 24 03:42:53 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:42:53.835847 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:53.836872 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] [instance: e29ee817-8013-43f1-a723-7da10144e24c] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:53.847762 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.848500 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.849168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.850283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.851039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.851687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.875650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] HTTP exception thrown: Instance e29ee817-8013-43f1-a723-7da10144e24c could not be found. Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Request method failure captured: Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c HTTP/1.1 Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZ4VazxzXQYEXZl6AM4ANQouL2mGiZ2NhtxTDYld8MKvAWPcjxw1-9ZrswOhCc2dIsnKw7ER_flab9qQMpYmWadtAVvNV5ieDxPHCk1svV3F_0Aj-hu0a6A2PlIwMU7UvQGO_DFUUuP8KxWJ0gJ4QZO1lSrAL4_mzC8MBP8W26ePf-s Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 097359f0dcfd4d289f56c08aaa025fad Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-VolumesActionsTest-1440849819 Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:42:53.878593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/097359f0dcfd4d289f56c08aaa025fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/097359f0dcfd4d289f56c08aaa025fad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/097359f0dcfd4d289f56c08aaa025fad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_097359f0dcfd4d289f56c08aaa025fad"}]}] Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-VolumesActionsTest-1440849819 Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 097359f0dcfd4d289f56c08aaa025fad Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-VolumesActionsTest-1440849819 Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-VolumesActionsTest-1440849819-project Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 01a1bb68c2294c6fb7806abf7349bd56 Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-VolumesActionsTest-1440849819-project Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance e29ee817-8013-43f1-a723-7da10144e24c could not be found. Aug 24 03:42:53.881149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'e29ee817-8013-43f1-a723-7da10144e24c'} Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29ee817-8013-43f1-a723-7da10144e24c could not be found. Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:53.882001 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29ee817-8013-43f1-a723-7da10144e24c could not be found. Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29ee817-8013-43f1-a723-7da10144e24c could not be found. Aug 24 03:42:53.883547 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:42:53.884758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] Returning 404 to user: Instance e29ee817-8013-43f1-a723-7da10144e24c could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:53.884758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7afc2f4e-b7d0-41c9-9f49-9c91c37c0c6b tempest-VolumesActionsTest-1440849819 tempest-VolumesActionsTest-1440849819-project] 10.222.0.78 "GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c" status: 404 len: 111 microversion: 2.1 time: 0.051645 Aug 24 03:42:53.884758 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 516/1040] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:53 2022] GET /compute/v2.1/servers/e29ee817-8013-43f1-a723-7da10144e24c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:53.892532 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:53.893423 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:53.903564 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.904434 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.905221 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.906810 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.907645 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.908421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.948725 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:53.970429 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:42:54.118793 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d90667e5-8a71-4e6d-a9d5-735e2abe6df7 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 204 len: 0 microversion: 2.1 time: 0.231418 Aug 24 03:42:54.119396 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 525/1041] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:53 2022] DELETE /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:42:54.128593 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:54.129217 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:54.137751 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:54.140208 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:54.140801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:54.142105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:54.142716 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:54.143092 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:54.398414 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:54.410353 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d644ed7d-f7d5-4693-9bdc-c5c7885966c6 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1680 microversion: 2.1 time: 0.286235 Aug 24 03:42:54.411364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 517/1042] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:54 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1680 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:55.438470 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:55.440716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:55.451186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:55.451993 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:55.452724 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:55.453954 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:55.454886 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:55.455716 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:55.681844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.695723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-261047d8-f983-4f22-923a-a269622efafc tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1680 microversion: 2.1 time: 0.263383 Aug 24 03:42:55.695723 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 526/1043] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:55 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:56.722626 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:56.724313 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:56.739985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:56.741610 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:56.742496 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:56.744257 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:56.745378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:56.746773 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:57.066927 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:57.089131 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-00d27443-8c92-40bf-bc3a-71354f63573c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1680 microversion: 2.1 time: 0.374408 Aug 24 03:42:57.095459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 518/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:56 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1680 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:58.038304 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-8938c840-1281-47ff-9813-719e1fb75ef3 req-28825632-e6ae-495c-8a06-705c1b40aad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b", "name": "network-vif-deleted", "tag": "8cc0756e-9952-409d-93e4-903c592a19df"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:58.065239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-8938c840-1281-47ff-9813-719e1fb75ef3 req-28825632-e6ae-495c-8a06-705c1b40aad9 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:58.066621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-8938c840-1281-47ff-9813-719e1fb75ef3 req-28825632-e6ae-495c-8a06-705c1b40aad9 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:58.067546 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-8938c840-1281-47ff-9813-719e1fb75ef3 req-28825632-e6ae-495c-8a06-705c1b40aad9 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:58.101940 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-8938c840-1281-47ff-9813-719e1fb75ef3 req-28825632-e6ae-495c-8a06-705c1b40aad9 service nova] Creating event network-vif-deleted:8cc0756e-9952-409d-93e4-903c592a19df for instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b on hv-cinder-85426 Aug 24 03:42:58.110733 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-8938c840-1281-47ff-9813-719e1fb75ef3 req-28825632-e6ae-495c-8a06-705c1b40aad9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080657 Aug 24 03:42:58.111243 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 527/1045] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:58.149581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:58.154175 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:58.174402 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:58.176274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:58.178218 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:58.183024 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:58.185831 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:58.189694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:58.280448 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:58.281484 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:58.282240 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:58.283317 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.objects.instance [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lazy-loading 'fault' on Instance uuid 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b {{(pid=127258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:42:58.366032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f447a34300944a5da25f6408f802f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3989b5dc1ded4718af973b4e794ff1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:58.372995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-8c0b4516-f880-448e-b72a-4a550611ada2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 200 len: 1331 microversion: 2.1 time: 0.236314 Aug 24 03:42:58.373896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 519/1046] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:58 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 1331 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:59.409938 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:59.410862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:59.418432 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:59.419052 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:59.419606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:59.420471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:59.420970 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:59.421460 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:59.444148 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b HTTP/1.1 Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:42:59.446036 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:42:59.448569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b'} Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:59.450407 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:42:59.453613 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:42:59.457004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:59.457004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dd8200b9-c84b-439e-a5e6-afb5186b4e30 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 404 len: 111 microversion: 2.1 time: 0.044199 Aug 24 03:42:59.457004 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 528/1047] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:59 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:59.461187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-465da026-efc0-429a-8c01-09c7b658a5e3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '.version_select at 0x7f4f44d4f9d0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:59.497920 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-465da026-efc0-429a-8c01-09c7b658a5e3 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705504263" status: 202 len: 0 microversion: 2.1 time: 0.043889 Aug 24 03:42:59.499601 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 520/1048] 10.222.0.78 () {58 vars in 1221 bytes} [Wed Aug 24 03:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705504263 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:43:01.754108 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:01.756349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:01.760292 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:01.770313 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.771269 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.772125 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.773354 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.774061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.775061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.799454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b HTTP/1.1 Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:01.801536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.803374 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b'} Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:01.804232 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.806020 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.808891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:01.809894 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-573a3743-a8a9-4aff-87aa-41a02a5e0500 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 404 len: 111 microversion: 2.1 time: 0.062089 Aug 24 03:43:01.810557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 529/1049] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:01 2022] DELETE /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:01.820560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:01.821279 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:01.828744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:01.832029 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.832687 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.833186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.834336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.835152 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.835694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.855838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b HTTP/1.1 Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:01.858491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.860314 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b'} Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:01.861332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. Aug 24 03:43:01.862833 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:01.865161 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:01.866234 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-229a1e98-c3a0-449e-964d-f646ba166fb4 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b" status: 404 len: 111 microversion: 2.1 time: 0.050570 Aug 24 03:43:01.867127 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 521/1050] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:01 2022] GET /compute/v2.1/servers/84d8ba8d-3ced-4f4d-bdbf-b2864a42f02b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:03.121341 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:03.123182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:03.131606 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.132127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.132754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.133747 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.134220 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.134766 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.153422 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a HTTP/1.1 Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:03.155146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.158439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': 'c745a230-ab54-4a5f-8a4d-d5a785f3c59a'} Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:03.161672 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.164814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.168859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:03.168859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-230b8d92-e05a-4c53-a72e-9776d92bf61c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 404 len: 111 microversion: 2.1 time: 0.050485 Aug 24 03:43:03.168859 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 530/1051] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:03 2022] DELETE /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:03.169532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:03.169532 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: c745a230-ab54-4a5f-8a4d-d5a785f3c59a] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:03.176299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.176806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.177256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.178344 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.178854 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.180190 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.198524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a HTTP/1.1 Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:03.199953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.202795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'c745a230-ab54-4a5f-8a4d-d5a785f3c59a'} Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:03.204336 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. Aug 24 03:43:03.206575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.209087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance c745a230-ab54-4a5f-8a4d-d5a785f3c59a could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:03.209087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-524e0fd2-f806-468a-8c88-3f56bee62743 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a" status: 404 len: 111 microversion: 2.1 time: 0.038909 Aug 24 03:43:03.209087 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 522/1052] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:03 2022] GET /compute/v2.1/servers/c745a230-ab54-4a5f-8a4d-d5a785f3c59a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:03.213242 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:03.213821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:03.223454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.224092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.224664 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.225650 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.226130 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.226876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.255670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 HTTP/1.1 Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:03.257282 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.258675 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '06ca164a-c24d-4225-89e6-d5718d7e88b4'} Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:03.259450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.260844 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.263404 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:03.264423 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-7913ddd2-88a1-4d78-ba90-d203e6837ea9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 404 len: 111 microversion: 2.1 time: 0.057047 Aug 24 03:43:03.265162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 531/1053] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:03 2022] DELETE /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:03.276458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:03.277114 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 06ca164a-c24d-4225-89e6-d5718d7e88b4] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:03.284209 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.284831 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.285278 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.286016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.286672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.287258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.304401 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 HTTP/1.1 Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:03.306841 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.308329 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '06ca164a-c24d-4225-89e6-d5718d7e88b4'} Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:03.309150 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. Aug 24 03:43:03.310332 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:03.312264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 06ca164a-c24d-4225-89e6-d5718d7e88b4 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:03.313516 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-da82b44c-42de-46bd-88e1-378ba5b8f4e9 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4" status: 404 len: 111 microversion: 2.1 time: 0.042413 Aug 24 03:43:03.314771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 523/1054] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:03 2022] GET /compute/v2.1/servers/06ca164a-c24d-4225-89e6-d5718d7e88b4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:43:04.584937 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:04.586169 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:04.605596 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.606454 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.616364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.617661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.618521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.619297 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.636022 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda HTTP/1.1 Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:04.637639 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.642186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '88ee23ad-01a0-4e1a-bef2-7b0d4019fbda'} Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:04.647371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.651880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.659557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:04.659557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-08dd48c6-cd6c-4d94-9d5c-9c90ba1afb1c tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "DELETE /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 404 len: 111 microversion: 2.1 time: 0.061893 Aug 24 03:43:04.659557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 532/1055] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:04 2022] DELETE /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:04.661966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:04.661966 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] [instance: 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:04.668460 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.669537 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.670149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.671560 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.676668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.676668 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.690032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] HTTP exception thrown: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Request method failure captured: Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda HTTP/1.1 Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvr2rFCisi-4cSgP0cr9VX0g7xVjcXzEqrOhveaZkTF2NN5QZFCkhTikDQv6RkgeVisa8Y8EyiY_ibgCobFszaNEKarhDGZ5HaJVBQvQWPTn8krOLq42bQB-jMILTuIc7sHjDkTZjJcU8xRLv-jeNhy0EpX4_c92fEJYztaieD7HWw Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:04.691667 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3989b5dc1ded4718af973b4e794ff1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3989b5dc1ded4718af973b4e794ff1be"}]}] Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 3989b5dc1ded4718af973b4e794ff1be Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545042037 Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: f447a34300944a5da25f6408f802f602 Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeNegativeTest-545042037-project Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.694043 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': '88ee23ad-01a0-4e1a-bef2-7b0d4019fbda'} Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:04.695437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. Aug 24 03:43:04.699518 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:04.702791 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] Returning 404 to user: Instance 88ee23ad-01a0-4e1a-bef2-7b0d4019fbda could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:04.702791 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-b3fe1d22-41c0-489f-bb18-8f0d60802fe2 tempest-AttachVolumeNegativeTest-545042037 tempest-AttachVolumeNegativeTest-545042037-project] 10.222.0.78 "GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda" status: 404 len: 111 microversion: 2.1 time: 0.044789 Aug 24 03:43:04.702791 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 524/1056] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:04 2022] GET /compute/v2.1/servers/88ee23ad-01a0-4e1a-bef2-7b0d4019fbda => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:12.167861 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d1c978a1-48b4-4419-985c-cdf158b8a3ff tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Action: 'create', calling method: .version_select at 0x7f4f44490f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-304425389", "metadata": {"Type": "work"}}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d1c978a1-48b4-4419-985c-cdf158b8a3ff tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Request method failure captured: Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 121 Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZ5PbmfMfVVyDgCpcd8qvrC-9qOmsPgypKbKOERFO6xQgObamBwaLG-akQ5kBTw-CNjrili3Aiy9jbNhwVoXrVydNsSea12bF2D-cSnW4UglSC1uUQzxSfksT96HyKDGQCRI1e6nmkQrDdMDCFAXqbVaeTeJPd47pYjDsCDtNYnwM3o Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:12.220916 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2b9eee381cc49c0bcf17594971db843"}]}] Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: b80312de00e74d7fa16ea604c06f8f1b Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-304425389", "metadata": {"Type": "work"}}} Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:43:12.223737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-304425389', 'metadata': {'Type': 'work'}}}} Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:12.225406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:43:12.228499 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:43:12.231862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:43:12.231862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.231862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d1c978a1-48b4-4419-985c-cdf158b8a3ff tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:12.231862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d1c978a1-48b4-4419-985c-cdf158b8a3ff tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.244131 Aug 24 03:43:12.231862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 533/1057] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 24 03:43:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:43:12.241936 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-03486c6f-ab00-45d1-912f-0984397aa1c2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Action: 'create', calling method: .version_select at 0x7f4f443621f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1055125080", "metadata": {"Type": "work"}}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-03486c6f-ab00-45d1-912f-0984397aa1c2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Request method failure captured: Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 120 Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZ5PbmfMfVVyDgCpcd8qvrC-9qOmsPgypKbKOERFO6xQgObamBwaLG-akQ5kBTw-CNjrili3Aiy9jbNhwVoXrVydNsSea12bF2D-cSnW4UglSC1uUQzxSfksT96HyKDGQCRI1e6nmkQrDdMDCFAXqbVaeTeJPd47pYjDsCDtNYnwM3o Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:12.250445 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2b9eee381cc49c0bcf17594971db843"}]}] Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: b80312de00e74d7fa16ea604c06f8f1b Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1055125080", "metadata": {"Type": "work"}}} Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: Aug 24 03:43:12.253062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1055125080', 'metadata': {'Type': 'work'}}}} Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi '0' Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:12.255330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:43:12.260639 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:43:12.263489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:43:12.263489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.263489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-03486c6f-ab00-45d1-912f-0984397aa1c2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:12.263489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-03486c6f-ab00-45d1-912f-0984397aa1c2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019659 Aug 24 03:43:12.263489 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 525/1058] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 24 03:43:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:43:12.267804 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e6c66767-6a72-48b4-9e0e-17dc4bd2e503 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Action: 'create', calling method: .version_select at 0x7f4f4684adc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1711914567", "metadata": {"Type": "work"}}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e6c66767-6a72-48b4-9e0e-17dc4bd2e503 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Request method failure captured: Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 119 Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZ5PbmfMfVVyDgCpcd8qvrC-9qOmsPgypKbKOERFO6xQgObamBwaLG-akQ5kBTw-CNjrili3Aiy9jbNhwVoXrVydNsSea12bF2D-cSnW4UglSC1uUQzxSfksT96HyKDGQCRI1e6nmkQrDdMDCFAXqbVaeTeJPd47pYjDsCDtNYnwM3o Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:12.274244 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2b9eee381cc49c0bcf17594971db843"}]}] Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: b80312de00e74d7fa16ea604c06f8f1b Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1711914567", "metadata": {"Type": "work"}}} Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:43:12.277362 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1711914567', 'metadata': {'Type': 'work'}}}} Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi '' Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:12.279127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:43:12.281519 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:43:12.284090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:43:12.284090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.284090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e6c66767-6a72-48b4-9e0e-17dc4bd2e503 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:12.284090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e6c66767-6a72-48b4-9e0e-17dc4bd2e503 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014432 Aug 24 03:43:12.284090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 534/1059] 10.222.0.78 () {60 vars in 1156 bytes} [Wed Aug 24 03:43:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:43:12.289985 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1b654ce8-a186-4f64-9b5d-66c55eebefe2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Calling method '.version_select at 0x7f4f44cdc700>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.332048 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-1b654ce8-a186-4f64-9b5d-66c55eebefe2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] HTTP exception thrown: Volume tempest-invalid-1199040223 could not be found. Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1b654ce8-a186-4f64-9b5d-66c55eebefe2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Request method failure captured: Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1199040223 HTTP/1.1 Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZ5PbmfMfVVyDgCpcd8qvrC-9qOmsPgypKbKOERFO6xQgObamBwaLG-akQ5kBTw-CNjrili3Aiy9jbNhwVoXrVydNsSea12bF2D-cSnW4UglSC1uUQzxSfksT96HyKDGQCRI1e6nmkQrDdMDCFAXqbVaeTeJPd47pYjDsCDtNYnwM3o Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:12.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2b9eee381cc49c0bcf17594971db843"}]}] Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: b80312de00e74d7fa16ea604c06f8f1b Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Volume tempest-invalid-1199040223 could not be found. Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'tempest-invalid-1199040223'} Aug 24 03:43:12.344650 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1199040223 could not be found. (HTTP 404) (Request-ID: req-0e40e172-8f8f-4af4-804a-1a97018f5527) Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.346285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:43:12.348478 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1199040223 could not be found. Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:12.350615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1199040223 could not be found. Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1199040223 could not be found. Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-1b654ce8-a186-4f64-9b5d-66c55eebefe2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Returning 404 to user: Volume tempest-invalid-1199040223 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-1b654ce8-a186-4f64-9b5d-66c55eebefe2 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1199040223" status: 404 len: 99 microversion: 2.1 time: 0.058560 Aug 24 03:43:12.353684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 526/1060] 10.222.0.78 () {58 vars in 1218 bytes} [Wed Aug 24 03:43:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1199040223 => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:43:12.362882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b19f393e-c53b-4a87-be7e-8a98ec99e6b9 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007447 Aug 24 03:43:12.362882 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 535/1061] 10.222.0.78 () {58 vars in 1140 bytes} [Wed Aug 24 03:43:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:43:12.373828 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-c0b809ee-870f-4c36-8507-7adfdd51590d tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005093 Aug 24 03:43:12.374744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 527/1062] 10.222.0.78 () {58 vars in 1137 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:43:12.392365 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f3e11d62-34f5-45c7-8fe8-ec38cae7f300 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Calling method '.version_select at 0x7f4f44490550>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.456497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-f3e11d62-34f5-45c7-8fe8-ec38cae7f300 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] HTTP exception thrown: Volume f68774e3-e507-44c9-b71f-0f8fb91e29e9 could not be found. Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f3e11d62-34f5-45c7-8fe8-ec38cae7f300 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Request method failure captured: Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: DELETE /compute/v2.1/os-volumes/f68774e3-e507-44c9-b71f-0f8fb91e29e9 HTTP/1.1 Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZ5PbmfMfVVyDgCpcd8qvrC-9qOmsPgypKbKOERFO6xQgObamBwaLG-akQ5kBTw-CNjrili3Aiy9jbNhwVoXrVydNsSea12bF2D-cSnW4UglSC1uUQzxSfksT96HyKDGQCRI1e6nmkQrDdMDCFAXqbVaeTeJPd47pYjDsCDtNYnwM3o Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:12.458554 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2b9eee381cc49c0bcf17594971db843"}]}] Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: b80312de00e74d7fa16ea604c06f8f1b Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Volume f68774e3-e507-44c9-b71f-0f8fb91e29e9 could not be found. Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': 'f68774e3-e507-44c9-b71f-0f8fb91e29e9'} Aug 24 03:43:12.460104 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f68774e3-e507-44c9-b71f-0f8fb91e29e9 could not be found. (HTTP 404) (Request-ID: req-a892b5a5-a32a-4f46-8dee-9ce9fff137b4) Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.460925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:43:12.462139 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f68774e3-e507-44c9-b71f-0f8fb91e29e9 could not be found. Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:43:12.463306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f68774e3-e507-44c9-b71f-0f8fb91e29e9 could not be found. Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f68774e3-e507-44c9-b71f-0f8fb91e29e9 could not be found. Aug 24 03:43:12.464505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.467390 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f3e11d62-34f5-45c7-8fe8-ec38cae7f300 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Returning 404 to user: Volume f68774e3-e507-44c9-b71f-0f8fb91e29e9 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:12.468610 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f3e11d62-34f5-45c7-8fe8-ec38cae7f300 tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/f68774e3-e507-44c9-b71f-0f8fb91e29e9" status: 404 len: 109 microversion: 2.1 time: 0.084833 Aug 24 03:43:12.469366 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 536/1063] 10.222.0.78 () {58 vars in 1248 bytes} [Wed Aug 24 03:43:12 2022] DELETE /compute/v2.1/os-volumes/f68774e3-e507-44c9-b71f-0f8fb91e29e9 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:12.484905 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-45392eaf-a988-411d-a6ff-eb220c3b268b tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Calling method '.version_select at 0x7f4f44d1c3a0>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.549744 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-45392eaf-a988-411d-a6ff-eb220c3b268b tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] HTTP exception thrown: Volume a45b4793-8def-4d79-8112-860c95388859 could not be found. Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-45392eaf-a988-411d-a6ff-eb220c3b268b tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Request method failure captured: Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/os-volumes/a45b4793-8def-4d79-8112-860c95388859 HTTP/1.1 Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZ5PbmfMfVVyDgCpcd8qvrC-9qOmsPgypKbKOERFO6xQgObamBwaLG-akQ5kBTw-CNjrili3Aiy9jbNhwVoXrVydNsSea12bF2D-cSnW4UglSC1uUQzxSfksT96HyKDGQCRI1e6nmkQrDdMDCFAXqbVaeTeJPd47pYjDsCDtNYnwM3o Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:12.552897 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b2b9eee381cc49c0bcf17594971db843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b2b9eee381cc49c0bcf17594971db843"}]}] Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: b2b9eee381cc49c0bcf17594971db843 Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-VolumesNegativeTest-512292328 Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: b80312de00e74d7fa16ea604c06f8f1b Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-VolumesNegativeTest-512292328-project Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Volume a45b4793-8def-4d79-8112-860c95388859 could not be found. Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'a45b4793-8def-4d79-8112-860c95388859'} Aug 24 03:43:12.556411 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a45b4793-8def-4d79-8112-860c95388859 could not be found. (HTTP 404) (Request-ID: req-bdb23842-fa9d-4dd1-baf8-6ee21967d350) Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.558896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:43:12.563063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a45b4793-8def-4d79-8112-860c95388859 could not be found. Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:43:12.567282 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a45b4793-8def-4d79-8112-860c95388859 could not be found. Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a45b4793-8def-4d79-8112-860c95388859 could not be found. Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-45392eaf-a988-411d-a6ff-eb220c3b268b tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] Returning 404 to user: Volume a45b4793-8def-4d79-8112-860c95388859 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-45392eaf-a988-411d-a6ff-eb220c3b268b tempest-VolumesNegativeTest-512292328 tempest-VolumesNegativeTest-512292328-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/a45b4793-8def-4d79-8112-860c95388859" status: 404 len: 109 microversion: 2.1 time: 0.077983 Aug 24 03:43:12.572502 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 528/1064] 10.222.0.78 () {58 vars in 1245 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/os-volumes/a45b4793-8def-4d79-8112-860c95388859 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:19.466214 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=7 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:19.468344 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:19.473284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1806188775", "imageRef": "f279d04b-94b6-4b01-9523-f6cd681f4695", "flavorRef": "452"}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:19.553206 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.network.neutron [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] validate_networks() for None {{(pid=127257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:43:20.065543 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Flavor limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:43:20.069498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Image limits 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:43:20.070300 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Flavor pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:43:20.071025 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Image pref 0:0:0 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:43:20.071760 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.virt.hardware [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:43:20.091767 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.092951 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.093666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.094797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.095451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.096099 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.127008 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Getting quotas for project 68fbe2908c054860a8424803fc82ca8d. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:20.134330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Getting quotas for user 059590563d49468f90913a148b541ed0 and project 68fbe2908c054860a8424803fc82ca8d. Resources: {'ram', 'instances', 'cores'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:20.153684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Going to run 1 instances... {{(pid=127257) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:43:20.158056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f279d04b-94b6-4b01-9523-f6cd681f4695',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:43:20.235521 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dd9d2bc0-9f94-49a5-9dcc-9776483adb8c tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770365 Aug 24 03:43:20.236696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 537/1065] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:43:20.249904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=7 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.251625 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.270187 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d3f423c2-972e-44e7-8c09-1ba2eac29bc8 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:20.271385 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d3f423c2-972e-44e7-8c09-1ba2eac29bc8 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:20.359904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d3f423c2-972e-44e7-8c09-1ba2eac29bc8 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:20.372398 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d3f423c2-972e-44e7-8c09-1ba2eac29bc8 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1215 microversion: 2.1 time: 0.125428 Aug 24 03:43:20.373436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 529/1066] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:20 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:21.405670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:21.407119 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:21.414338 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.414872 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.415306 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.416058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.416665 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.417162 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.503548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:21.522204 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-149eeaa9-0b79-4039-a68e-75b1bfe99658 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1267 microversion: 2.1 time: 0.116498 Aug 24 03:43:21.522914 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 538/1067] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:21 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1267 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:22.547771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:22.548685 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:22.556723 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.557777 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.558337 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.559461 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.560178 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.560704 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.664971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:22.680003 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-726898ce-3bbf-4856-80d0-1819c6ce4b5d tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1273 microversion: 2.1 time: 0.137078 Aug 24 03:43:22.680608 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 530/1068] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:22 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:23.718343 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.719090 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:23.726624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.727167 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.727608 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.728330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.728876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.729433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.998201 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:24.012287 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ee5a5b18-7ade-475a-ad8e-7230b4c17f67 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.298504 Aug 24 03:43:24.013589 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 539/1069] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:24.395003 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-3715863d-07fc-467f-a15a-0a599cec0f94 req-684e7b8a-1dbd-4f61-8aec-519661eb6418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467982ef-0f7a-41d5-8d44-b5ff94891971", "tag": "db63b632-11dc-41e3-82d2-8bd02f33a5ad"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:24.416491 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3715863d-07fc-467f-a15a-0a599cec0f94 req-684e7b8a-1dbd-4f61-8aec-519661eb6418 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.417080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3715863d-07fc-467f-a15a-0a599cec0f94 req-684e7b8a-1dbd-4f61-8aec-519661eb6418 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.417519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-3715863d-07fc-467f-a15a-0a599cec0f94 req-684e7b8a-1dbd-4f61-8aec-519661eb6418 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.433318 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-3715863d-07fc-467f-a15a-0a599cec0f94 req-684e7b8a-1dbd-4f61-8aec-519661eb6418 service nova] Creating event network-changed:db63b632-11dc-41e3-82d2-8bd02f33a5ad for instance 467982ef-0f7a-41d5-8d44-b5ff94891971 on hv-cinder-85426 Aug 24 03:43:24.442908 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-3715863d-07fc-467f-a15a-0a599cec0f94 req-684e7b8a-1dbd-4f61-8aec-519661eb6418 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051827 Aug 24 03:43:24.442908 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 531/1070] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:25.035471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.036106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:25.051687 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.051687 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.051687 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.051687 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.052199 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.052199 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.233159 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.245739 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-dbaaa921-691f-4413-9a77-dc123f69f790 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.213639 Aug 24 03:43:25.246413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 540/1071] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:25 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:26.279484 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:26.280948 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:26.287267 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.287752 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.288193 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.288928 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.289385 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.289816 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.449155 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:26.465494 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5024593a-89f5-4534-913e-7526186a230f tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.190627 Aug 24 03:43:26.466524 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 532/1072] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:26 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:27.504569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:27.506218 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:27.527076 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.528624 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.529661 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.531633 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.532531 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.533336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.813569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:27.828877 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c1d2fb0a-6164-413e-8a55-5844109a309a tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.331791 Aug 24 03:43:27.839070 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 541/1073] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:27 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:28.865777 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:28.866617 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:28.877014 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.877551 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.878012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.878919 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.879456 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.879928 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.123317 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:29.135848 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d7b7e7c5-b631-4020-bf0a-f90fc144e2f2 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.277799 Aug 24 03:43:29.136759 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 533/1074] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:28 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:30.163505 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:30.167512 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:30.173836 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:30.175431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=6 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:30.187285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.187285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.187285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.188614 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.190967 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.191801 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.426027 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:30.438862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-c4d330a5-4016-4fcf-ae59-2d7e17d61190 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.281289 Aug 24 03:43:30.440870 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 542/1075] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:30 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:31.380665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-17b4aba9-d608-495e-bfda-deefdec129db req-b001b834-f8ec-463a-87f2-f1c04a93ceeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467982ef-0f7a-41d5-8d44-b5ff94891971", "name": "network-vif-plugged", "status": "completed", "tag": "db63b632-11dc-41e3-82d2-8bd02f33a5ad"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:31.421405 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:31.431494 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-17b4aba9-d608-495e-bfda-deefdec129db req-b001b834-f8ec-463a-87f2-f1c04a93ceeb service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.435111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-17b4aba9-d608-495e-bfda-deefdec129db req-b001b834-f8ec-463a-87f2-f1c04a93ceeb service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.436222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-17b4aba9-d608-495e-bfda-deefdec129db req-b001b834-f8ec-463a-87f2-f1c04a93ceeb service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.470258 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:31.472615 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:31.502772 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-17b4aba9-d608-495e-bfda-deefdec129db req-b001b834-f8ec-463a-87f2-f1c04a93ceeb service nova] Creating event network-vif-plugged:db63b632-11dc-41e3-82d2-8bd02f33a5ad for instance 467982ef-0f7a-41d5-8d44-b5ff94891971 on hv-cinder-85426 Aug 24 03:43:31.515799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.516588 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.521578 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.522816 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.524376 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.526602 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.536519 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-17b4aba9-d608-495e-bfda-deefdec129db req-b001b834-f8ec-463a-87f2-f1c04a93ceeb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171410 Aug 24 03:43:31.539904 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 534/1076] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:43:31.896593 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:31.907421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-40213137-3907-4def-ad3b-6eae5f249a7b tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.447921 Aug 24 03:43:31.908121 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 543/1077] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:31 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:32.962379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:32.964953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:32.981031 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.982351 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.983378 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.984979 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.985970 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.987256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.415446 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:33.438222 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a499892c-47c8-4b71-90d7-a5f72b75fad4 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1315 microversion: 2.1 time: 0.509857 Aug 24 03:43:33.442015 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 535/1078] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:32 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:34.472030 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:34.473039 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:34.486706 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.487640 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.488450 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.490111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.490947 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.491910 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.893975 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:34.912884 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-336af842-0c2c-4c08-b507-57db120363df tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1465 microversion: 2.1 time: 0.446691 Aug 24 03:43:34.915777 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 544/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:34 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1465 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:35.026855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:35.027707 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:35.044111 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.044916 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.045813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.046729 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.047451 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.048159 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.134905 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Going to try to terminate instance {{(pid=127258) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:35.332213 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0dbfb13a-4fad-4a2c-b279-79d22f68f9e3 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "DELETE /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 204 len: 0 microversion: 2.1 time: 0.309986 Aug 24 03:43:35.339684 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 536/1080] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:35 2022] DELETE /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:43:35.354527 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:35.356131 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:35.373182 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.374922 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.376978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.378531 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.380483 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.381476 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.084351 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:36.099995 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4bbf8e9f-bd51-4faf-9ae2-e90f3fcffcd9 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1471 microversion: 2.1 time: 0.753239 Aug 24 03:43:36.101259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 545/1081] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:35 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1471 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:37.140638 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:37.143875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:37.157141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.158105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.159262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.162973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.162973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.162973 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.444427 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:37.458341 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d1e9195e-94a3-41ab-983e-25675f475a69 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1471 microversion: 2.1 time: 0.326650 Aug 24 03:43:37.459259 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 537/1082] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:37 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:38.502377 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:38.503776 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:38.524082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.525391 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.526238 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.527695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.528766 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.530346 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.799423 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059590563d49468f90913a148b541ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fbe2908c054860a8424803fc82ca8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:38.828044 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-de3817ca-936c-4ed3-af63-88e1223c3df6 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 200 len: 1429 microversion: 2.1 time: 0.325290 Aug 24 03:43:38.841584 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 546/1083] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:38 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 1429 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:39.208416 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-48ec7402-dc68-483a-8788-382d1f3689f5 req-425bd043-aa51-4cec-8500-3c3121bb2d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467982ef-0f7a-41d5-8d44-b5ff94891971", "name": "network-vif-deleted", "tag": "db63b632-11dc-41e3-82d2-8bd02f33a5ad"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:39.240749 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-48ec7402-dc68-483a-8788-382d1f3689f5 req-425bd043-aa51-4cec-8500-3c3121bb2d65 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.241455 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-48ec7402-dc68-483a-8788-382d1f3689f5 req-425bd043-aa51-4cec-8500-3c3121bb2d65 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.244376 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-48ec7402-dc68-483a-8788-382d1f3689f5 req-425bd043-aa51-4cec-8500-3c3121bb2d65 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.272795 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-48ec7402-dc68-483a-8788-382d1f3689f5 req-425bd043-aa51-4cec-8500-3c3121bb2d65 service nova] Creating event network-vif-deleted:db63b632-11dc-41e3-82d2-8bd02f33a5ad for instance 467982ef-0f7a-41d5-8d44-b5ff94891971 on hv-cinder-85426 Aug 24 03:43:39.288363 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-48ec7402-dc68-483a-8788-382d1f3689f5 req-425bd043-aa51-4cec-8500-3c3121bb2d65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391855 Aug 24 03:43:39.292725 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 538/1084] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:43:39.887497 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:39.895991 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] [instance: 467982ef-0f7a-41d5-8d44-b5ff94891971] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:39.924696 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.931446 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.932430 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.933952 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.934863 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.937330 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.967663 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] HTTP exception thrown: Instance 467982ef-0f7a-41d5-8d44-b5ff94891971 could not be found. Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Request method failure captured: Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 HTTP/1.1 Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZ5V8xZYKidgH5yuOvDlLm1-7DRWGz2wNfKOtLZ_cm8oTW8ZDQ9LhREH3pWijatJrfzP5lZzLDCiDhBYQECftn2c_RhYtxUdFp_VSAfn9SNkDOOzXHz72XNtBM9Z1yqNrN3bmEVzeCM8gdego7czyZeYIzv1oQCjeTOwsVLiT8Rz9Vg Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 68fbe2908c054860a8424803fc82ca8d Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-VolumesNegativeTest-1860442716 Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:39.977187 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68fbe2908c054860a8424803fc82ca8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68fbe2908c054860a8424803fc82ca8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/68fbe2908c054860a8424803fc82ca8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_68fbe2908c054860a8424803fc82ca8d"}]}] Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-VolumesNegativeTest-1860442716 Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 68fbe2908c054860a8424803fc82ca8d Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-VolumesNegativeTest-1860442716 Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-VolumesNegativeTest-1860442716-project Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 059590563d49468f90913a148b541ed0 Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-VolumesNegativeTest-1860442716-project Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance 467982ef-0f7a-41d5-8d44-b5ff94891971 could not be found. Aug 24 03:43:39.980226 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': '467982ef-0f7a-41d5-8d44-b5ff94891971'} Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 467982ef-0f7a-41d5-8d44-b5ff94891971 could not be found. Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:39.981941 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 467982ef-0f7a-41d5-8d44-b5ff94891971 could not be found. Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 467982ef-0f7a-41d5-8d44-b5ff94891971 could not be found. Aug 24 03:43:39.991239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.993963 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] Returning 404 to user: Instance 467982ef-0f7a-41d5-8d44-b5ff94891971 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:39.993963 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e50e0bd8-ce80-41a4-9fda-0b1d16945445 tempest-VolumesNegativeTest-1860442716 tempest-VolumesNegativeTest-1860442716-project] 10.222.0.78 "GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971" status: 404 len: 111 microversion: 2.1 time: 0.110152 Aug 24 03:43:40.003498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 547/1085] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:39 2022] GET /compute/v2.1/servers/467982ef-0f7a-41d5-8d44-b5ff94891971 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:48.629467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:48.632352 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:48.643622 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.645381 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.646586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.647696 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.649492 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.650249 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.695362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3243512b-4080-45d2-add0-88041e267e9d tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.117055 Aug 24 03:43:48.696291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 539/1086] 10.222.0.78 () {60 vars in 1343 bytes} [Wed Aug 24 03:43:48 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:48.812113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:48.813062 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:48.837930 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.839632 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.840897 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.843113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.844643 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.848071 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.924298 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:49.127992 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-edce1fc2-95cc-4975-939c-21ef6ab7bd12 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 204 len: 0 microversion: 2.20 time: 0.323941 Aug 24 03:43:49.130439 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 548/1087] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 24 03:43:48 2022] DELETE /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:43:49.143525 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:49.148276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:49.169633 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:49.171063 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:49.172090 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:49.173660 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:49.174775 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:49.176351 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:49.517739 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:49.529248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:49.531340 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:49.532716 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-41b9f4f7-9edd-4f72-9457-d2379fb0f3b1 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.396961 Aug 24 03:43:49.533866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 540/1088] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:49 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:50.136945 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d4db32f3-0ae1-4b40-aa76-8e79acad1e88 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Action: 'create', calling method: .version_select at 0x7f4f444e4550>, body: {"keypair": {"name": "tempest-TestShelveInstance-199082765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZmFxSVlfhoCR/vsR1uGTgWX9Btu69xF0nK5rkGRLccV60aM/B735vvL7t7Zcu3WJh+4/MXwwFlVWNfY8ff3MIYMCr8baTJPm8aF+7+svWw5fZFi0gz2bhss4XBiCIBnQ=="}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:50.146222 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:50.161695 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-d4db32f3-0ae1-4b40-aa76-8e79acad1e88 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Getting quotas for project 27a7ba12af984afda9b6d9ef80d4434f. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:50.166559 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.quota [None req-d4db32f3-0ae1-4b40-aa76-8e79acad1e88 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Getting quotas for user abda0f0b14fe4e5f8a8af0525c2e0e62 and project 27a7ba12af984afda9b6d9ef80d4434f. Resources: {'key_pairs'} {{(pid=127257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:50.206842 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d4db32f3-0ae1-4b40-aa76-8e79acad1e88 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.628240 Aug 24 03:43:50.208794 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 549/1089] 10.222.0.78 () {60 vars in 1159 bytes} [Wed Aug 24 03:43:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:50.567440 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:50.570022 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:50.574548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:50.584792 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.585994 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.601291 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.602877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.603876 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.604763 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.611449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:50.888230 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:50.923395 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:50.933156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:50.939408 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5c593f2e-a8e1-450a-a2e3-e2aa6bd29af3 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1724 microversion: 2.20 time: 0.379643 Aug 24 03:43:50.952397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 541/1090] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:50 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:51.963950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:51.964724 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:51.973713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:51.974260 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:51.974973 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:51.975896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:51.976549 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:51.977876 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:51.983364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:52.104710 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:52.116443 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:52.118436 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:52.119737 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-1ea33040-3cf4-4243-b066-3894dd31082b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1657 microversion: 2.20 time: 0.160156 Aug 24 03:43:52.130862 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 550/1091] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:51 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1657 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:43:52.930948 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-2c612e13-ae56-4275-b728-9069e725cc25 req-c470d3fb-653f-44bb-a67a-385125275162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6880b5-1956-4d0a-b158-c65c6b7bd948", "name": "network-vif-deleted", "tag": "07002f87-3795-4afe-ab6b-c223cea78539"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:52.946233 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2c612e13-ae56-4275-b728-9069e725cc25 req-c470d3fb-653f-44bb-a67a-385125275162 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.948105 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2c612e13-ae56-4275-b728-9069e725cc25 req-c470d3fb-653f-44bb-a67a-385125275162 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.949121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-2c612e13-ae56-4275-b728-9069e725cc25 req-c470d3fb-653f-44bb-a67a-385125275162 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.973297 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-2c612e13-ae56-4275-b728-9069e725cc25 req-c470d3fb-653f-44bb-a67a-385125275162 service nova] Creating event network-vif-deleted:07002f87-3795-4afe-ab6b-c223cea78539 for instance be6880b5-1956-4d0a-b158-c65c6b7bd948 on hv-cinder-85426 Aug 24 03:43:52.984755 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-2c612e13-ae56-4275-b728-9069e725cc25 req-c470d3fb-653f-44bb-a67a-385125275162 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057733 Aug 24 03:43:52.987462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 542/1092] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:53.144879 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:53.145694 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:53.161629 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.163569 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.165925 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.168684 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.169447 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.170285 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.213983 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.214522 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.215001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.215471 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lazy-loading 'fault' on Instance uuid be6880b5-1956-4d0a-b158-c65c6b7bd948 {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:43:53.268158 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:53.285654 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:53.288750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45285b561f424fde9297724c6768250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70bebe773822488a90a1258551c3f09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:53.290092 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ebd5d9d2-b379-4aff-8204-8c489e79b228 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 200 len: 1372 microversion: 2.20 time: 0.150050 Aug 24 03:43:53.291424 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 551/1093] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:53 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:54.316315 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:54.317156 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:54.326276 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.327079 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.327717 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.328665 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.329262 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.329843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.358012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] HTTP exception thrown: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Request method failure captured: Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 HTTP/1.1 Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvpx8_nChZ2GrTwo3_wmJm8TJ-pZPWlaJY7_lM48KMCb1XcoZbf4QN8UWkQpJ9bZqfvGfza7JZXKAG5OcMVjybxC8qink6GRAh8VVsyB90pOd4e-4dL4ZqozvBt3NS5Bdc6q8c_6rBQtjp2vOc4LciNwwJNRDdkifAunoESJArsqYM Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:54.361248 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70bebe773822488a90a1258551c3f09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70bebe773822488a90a1258551c3f09b"}]}] Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 45285b561f424fde9297724c6768250d Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:54.363004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'be6880b5-1956-4d0a-b158-c65c6b7bd948'} Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:54.363953 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:54.365468 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:54.366941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Returning 404 to user: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:54.366941 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3afb8195-8f9f-48b4-b5ca-876f89fe9d75 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 404 len: 111 microversion: 2.20 time: 0.052263 Aug 24 03:43:54.369879 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 543/1094] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:54 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:43:54.375211 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9f957563-7553-40e3-989d-4f090db58502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '.version_select at 0x7f4f44514040>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:54.398367 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9f957563-7553-40e3-989d-4f090db58502 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111701332" status: 204 len: 0 microversion: 2.20 time: 0.027239 Aug 24 03:43:54.399026 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 552/1095] 10.222.0.78 () {60 vars in 1262 bytes} [Wed Aug 24 03:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111701332 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:43:56.624807 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:56.626330 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:56.635056 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.635727 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.636287 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.637404 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.637978 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.638557 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.655176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] HTTP exception thrown: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Request method failure captured: Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: DELETE /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 HTTP/1.1 Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvpx8_nChZ2GrTwo3_wmJm8TJ-pZPWlaJY7_lM48KMCb1XcoZbf4QN8UWkQpJ9bZqfvGfza7JZXKAG5OcMVjybxC8qink6GRAh8VVsyB90pOd4e-4dL4ZqozvBt3NS5Bdc6q8c_6rBQtjp2vOc4LciNwwJNRDdkifAunoESJArsqYM Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:56.656801 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70bebe773822488a90a1258551c3f09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70bebe773822488a90a1258551c3f09b"}]}] Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 45285b561f424fde9297724c6768250d Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.658538 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'be6880b5-1956-4d0a-b158-c65c6b7bd948'} Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:56.659914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.662035 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.664458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Returning 404 to user: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:56.664458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-05bfd052-f6a0-419a-860a-b66985a0c08c tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 404 len: 111 microversion: 2.20 time: 0.038819 Aug 24 03:43:56.664458 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 544/1096] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 24 03:43:56 2022] DELETE /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:43:56.667336 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:56.668084 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: be6880b5-1956-4d0a-b158-c65c6b7bd948] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:56.675854 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.676349 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.676789 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.677502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.677978 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.678406 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.693832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] HTTP exception thrown: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Request method failure captured: Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 HTTP/1.1 Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvpx8_nChZ2GrTwo3_wmJm8TJ-pZPWlaJY7_lM48KMCb1XcoZbf4QN8UWkQpJ9bZqfvGfza7JZXKAG5OcMVjybxC8qink6GRAh8VVsyB90pOd4e-4dL4ZqozvBt3NS5Bdc6q8c_6rBQtjp2vOc4LciNwwJNRDdkifAunoESJArsqYM Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:56.695621 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70bebe773822488a90a1258551c3f09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70bebe773822488a90a1258551c3f09b"}]}] Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 45285b561f424fde9297724c6768250d Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.697361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': 'be6880b5-1956-4d0a-b158-c65c6b7bd948'} Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:56.698278 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. Aug 24 03:43:56.699867 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.701202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Returning 404 to user: Instance be6880b5-1956-4d0a-b158-c65c6b7bd948 could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:56.701202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d87a992f-c52b-4b76-b8e3-f69e2d3564a4 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948" status: 404 len: 111 microversion: 2.20 time: 0.033725 Aug 24 03:43:56.701202 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 553/1097] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:56 2022] GET /compute/v2.1/servers/be6880b5-1956-4d0a-b158-c65c6b7bd948 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:43:57.883273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:57.884699 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:57.898382 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.898980 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.899476 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.900359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.901011 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.901483 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.917437 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] HTTP exception thrown: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Request method failure captured: Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: DELETE /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd HTTP/1.1 Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZvpx8_nChZ2GrTwo3_wmJm8TJ-pZPWlaJY7_lM48KMCb1XcoZbf4QN8UWkQpJ9bZqfvGfza7JZXKAG5OcMVjybxC8qink6GRAh8VVsyB90pOd4e-4dL4ZqozvBt3NS5Bdc6q8c_6rBQtjp2vOc4LciNwwJNRDdkifAunoESJArsqYM Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:43:57.919068 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70bebe773822488a90a1258551c3f09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70bebe773822488a90a1258551c3f09b"}]}] Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: 45285b561f424fde9297724c6768250d Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.921430 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'aaca649f-ad0a-4355-b741-7e46388c74cd'} Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:57.923423 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.925388 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.927563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Returning 404 to user: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:57.927563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-f47c6f7b-9b9b-4402-a80a-e886be581f1b tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 404 len: 111 microversion: 2.20 time: 0.044146 Aug 24 03:43:57.927563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 545/1098] 10.222.0.78 () {60 vars in 1280 bytes} [Wed Aug 24 03:43:57 2022] DELETE /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:43:57.930999 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:57.931703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] [instance: aaca649f-ad0a-4355-b741-7e46388c74cd] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:57.939669 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.940165 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.940614 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.941337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.941799 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.942223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.957140 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.wsgi [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] HTTP exception thrown: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Request method failure captured: Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: request: GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd HTTP/1.1 Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept: application/json Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Accept-Encoding: identity Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Connection: close Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Length: 0 Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Content-Type: application/json Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Host: 10.222.0.78 Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Openstack-System-Scope: None Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Auth-Token: gAAAAABjBZvpx8_nChZ2GrTwo3_wmJm8TJ-pZPWlaJY7_lM48KMCb1XcoZbf4QN8UWkQpJ9bZqfvGfza7JZXKAG5OcMVjybxC8qink6GRAh8VVsyB90pOd4e-4dL4ZqozvBt3NS5Bdc6q8c_6rBQtjp2vOc4LciNwwJNRDdkifAunoESJArsqYM Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Id: None Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Domain-Name: None Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Identity-Status: Confirmed Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Is-Admin-Project: True Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Id: default Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Domain-Name: Default Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Role: reader,member Aug 24 03:43:57.958753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Roles: reader,member Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70bebe773822488a90a1258551c3f09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70bebe773822488a90a1258551c3f09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70bebe773822488a90a1258551c3f09b"}]}] Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Id: 70bebe773822488a90a1258551c3f09b Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889658743 Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Id: default Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Domain-Name: Default Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Id: 45285b561f424fde9297724c6768250d Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889658743-project Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: method: > Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: exception: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.960331 dv-cinder-854260-1-smb devstack@n-api.service[127257]: action_args: {'id': 'aaca649f-ad0a-4355-b741-7e46388c74cd'} Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:57.961433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. Aug 24 03:43:57.962909 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR nova.api.openstack.wsgi Aug 24 03:43:57.964019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] Returning 404 to user: Instance aaca649f-ad0a-4355-b741-7e46388c74cd could not be found. {{(pid=127257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:57.964019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-65cdf311-c824-4d94-82cd-3850d010db58 tempest-AttachVolumeShelveTestJSON-889658743 tempest-AttachVolumeShelveTestJSON-889658743-project] 10.222.0.78 "GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd" status: 404 len: 111 microversion: 2.20 time: 0.034273 Aug 24 03:43:57.964019 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 554/1099] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:57 2022] GET /compute/v2.1/servers/aaca649f-ad0a-4355-b741-7e46388c74cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:44:17.675520 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1355021669", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-199082765", "security_groups": [{"name": "tempest-secgroup-smoke-33906744"}], "networks": [{"uuid": "37998b66-08f0-4209-85cc-e648c34c4ac5"}], "block_device_mapping_v2": [{"uuid": "97b542c5-d696-431a-976a-b57b0b1f256b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:17.687339 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=9 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:17.688227 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=13 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:17.854070 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.network.neutron [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] validate_networks() for [('37998b66-08f0-4209-85cc-e648c34c4ac5', None, None, None, None, None)] {{(pid=127258) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:18.476866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Flavor limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:18.477629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Image limits 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:18.478806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Flavor pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:18.479563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Image pref 0:0:0 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:18.480325 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.virt.hardware [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:18.497403 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.501866 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.502676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.504317 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.506782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.506782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.543258 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Getting quotas for project 27a7ba12af984afda9b6d9ef80d4434f. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:18.561170 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.quota [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Getting quotas for user abda0f0b14fe4e5f8a8af0525c2e0e62 and project 27a7ba12af984afda9b6d9ef80d4434f. Resources: {'ram', 'instances', 'cores'} {{(pid=127258) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:18.689694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Going to run 1 instances... {{(pid=127258) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:18.695359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97b542c5-d696-431a-976a-b57b0b1f256b',volume_size=None,volume_type=None)] {{(pid=127258) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:18.979343 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-a660a37f-e50f-4542-a6f2-6052c1f3d18f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.308494 Aug 24 03:44:18.980885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 546/1100] 10.222.0.78 () {60 vars in 1147 bytes} [Wed Aug 24 03:44:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:44:19.005383 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ddc69187-4ad5-4cd7-b38a-fa52b98e488f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:19.009997 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ddc69187-4ad5-4cd7-b38a-fa52b98e488f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:19.027556 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=4 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.029545 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.030934 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=17 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.113113 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ddc69187-4ad5-4cd7-b38a-fa52b98e488f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.129529 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ddc69187-4ad5-4cd7-b38a-fa52b98e488f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1088 microversion: 2.1 time: 0.137257 Aug 24 03:44:19.131361 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 555/1101] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:18 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1088 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:20.158768 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:20.161123 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:20.174549 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.176160 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.177346 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.179283 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.179984 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.180806 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.291871 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:20.301263 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-cb2c77e1-dbae-4c53-966e-890693e521e4 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1138 microversion: 2.1 time: 0.148602 Aug 24 03:44:20.301889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 547/1102] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:20 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1138 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:21.329703 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:21.330721 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:21.343329 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.344889 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.346146 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.347974 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.349127 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.350025 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.503028 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:21.517924 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fa86059b-7ac7-454d-8454-24b384ddb7e7 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1204 microversion: 2.1 time: 0.195693 Aug 24 03:44:21.519728 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 556/1103] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:21 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1204 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:22.554931 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:22.555951 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:22.565016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.565690 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.566259 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.567211 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.567784 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.568417 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.790750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:22.805875 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-18ae653a-43e8-4fb7-b00f-3faf5c03d5a9 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.257333 Aug 24 03:44:22.806776 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 548/1104] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:22 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:23.181427 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-b362a80c-058c-4265-a474-d655ebd6eb09 req-1a849538-dec8-4e30-8a19-a783b8c352a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef32f148-b349-40d9-9208-23365dc3f10b", "tag": "48cf2d1d-960b-4b4f-896f-2de3f6ab663f"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:23.203709 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-b362a80c-058c-4265-a474-d655ebd6eb09 req-1a849538-dec8-4e30-8a19-a783b8c352a2 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.204527 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-b362a80c-058c-4265-a474-d655ebd6eb09 req-1a849538-dec8-4e30-8a19-a783b8c352a2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.205339 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-b362a80c-058c-4265-a474-d655ebd6eb09 req-1a849538-dec8-4e30-8a19-a783b8c352a2 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.226864 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-b362a80c-058c-4265-a474-d655ebd6eb09 req-1a849538-dec8-4e30-8a19-a783b8c352a2 service nova] Creating event network-changed:48cf2d1d-960b-4b4f-896f-2de3f6ab663f for instance ef32f148-b349-40d9-9208-23365dc3f10b on hv-cinder-85426 Aug 24 03:44:23.238797 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-b362a80c-058c-4265-a474-d655ebd6eb09 req-1a849538-dec8-4e30-8a19-a783b8c352a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066088 Aug 24 03:44:23.240290 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 557/1105] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:23.833586 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.834467 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.843237 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.843846 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.844374 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.845415 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.846121 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.846829 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.048706 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:24.059184 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-998f1163-0cea-41da-8d9e-6d8c56776516 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.230770 Aug 24 03:44:24.060021 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 549/1106] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:23 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:25.091736 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:25.092371 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:25.099538 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.100040 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.100484 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.101194 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.101651 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.102080 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.260170 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:25.269296 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-d5231545-4e94-4407-b98a-fc3378fc12cb tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.190590 Aug 24 03:44:25.269905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 558/1107] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:25 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:26.306825 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:26.308273 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:26.319842 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.321633 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.322364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.323615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.324380 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.325107 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.517459 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:26.535292 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-85a433e5-e5fd-4937-9269-c6dc8b9ef125 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.237362 Aug 24 03:44:26.537201 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 550/1108] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:26 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:27.558891 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:27.559498 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:27.566751 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.567267 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.567709 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.568433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.568895 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.569324 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.722517 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:27.732575 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e62800c9-4966-46ff-9a8b-4b7e4ec653c0 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.177725 Aug 24 03:44:27.733370 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 559/1109] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:27 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:28.754915 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:28.755552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:28.757991 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=2 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:28.758750 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell0:SELECT=6 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:28.768704 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.769269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.769919 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.770894 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.771572 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.772338 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.925012 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.934386 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0f6e205d-43a6-4003-8795-4acfc81796a8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.183549 Aug 24 03:44:28.935016 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 551/1110] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:28 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:29.849530 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell0:SELECT=2 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:29.964724 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:29.966877 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:29.979313 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.980563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.981561 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.983782 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.984914 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.985879 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.140064 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-89cc91bd-e25d-4528-b5f7-068eddaa1cd6 req-dcfe181c-f5bd-4165-be33-d8c3763aad52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32f148-b349-40d9-9208-23365dc3f10b", "name": "network-vif-plugged", "status": "completed", "tag": "48cf2d1d-960b-4b4f-896f-2de3f6ab663f"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:30.157963 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-89cc91bd-e25d-4528-b5f7-068eddaa1cd6 req-dcfe181c-f5bd-4165-be33-d8c3763aad52 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.159239 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-89cc91bd-e25d-4528-b5f7-068eddaa1cd6 req-dcfe181c-f5bd-4165-be33-d8c3763aad52 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.160207 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-89cc91bd-e25d-4528-b5f7-068eddaa1cd6 req-dcfe181c-f5bd-4165-be33-d8c3763aad52 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.185136 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-89cc91bd-e25d-4528-b5f7-068eddaa1cd6 req-dcfe181c-f5bd-4165-be33-d8c3763aad52 service nova] Creating event network-vif-plugged:48cf2d1d-960b-4b4f-896f-2de3f6ab663f for instance ef32f148-b349-40d9-9208-23365dc3f10b on hv-cinder-85426 Aug 24 03:44:30.195563 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-89cc91bd-e25d-4528-b5f7-068eddaa1cd6 req-dcfe181c-f5bd-4165-be33-d8c3763aad52 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355330 Aug 24 03:44:30.198132 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 560/1111] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:30.267815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.283264 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4e0d1aa5-e5eb-4048-9e05-b4c4796d38ec tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.327695 Aug 24 03:44:30.285244 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 552/1112] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:29 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:31.321476 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:31.322314 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:31.331001 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.331726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.332504 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.333827 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.334479 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.336857 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.534903 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:31.543809 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-8691439d-20a5-4ac7-b311-3370eea75014 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1258 microversion: 2.1 time: 0.227943 Aug 24 03:44:31.544413 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 561/1113] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:31 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1258 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:32.570567 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:32.571707 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:32.582213 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.583039 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.583672 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.585083 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.585889 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.586522 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.819149 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:32.829924 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-bf2107eb-fc99-407e-a96d-69c547a25077 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1442 microversion: 2.1 time: 0.266176 Aug 24 03:44:32.831125 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 553/1114] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:32 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1442 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:32.858662 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:32.860814 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:32.870271 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.871061 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.871715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.872750 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.873472 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.874023 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.054490 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.063398 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b7fde479-0ac6-4035-be11-ece4134cff7e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1442 microversion: 2.1 time: 0.211752 Aug 24 03:44:33.063981 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 562/1115] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:32 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1442 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:35.767934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-7f40196d-8a6a-4565-9800-db7245216d14 req-8f24ec88-ead3-4dea-ab8a-699a26de50e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef32f148-b349-40d9-9208-23365dc3f10b", "tag": "48cf2d1d-960b-4b4f-896f-2de3f6ab663f"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:35.780543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7f40196d-8a6a-4565-9800-db7245216d14 req-8f24ec88-ead3-4dea-ab8a-699a26de50e3 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.781252 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7f40196d-8a6a-4565-9800-db7245216d14 req-8f24ec88-ead3-4dea-ab8a-699a26de50e3 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.781837 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-7f40196d-8a6a-4565-9800-db7245216d14 req-8f24ec88-ead3-4dea-ab8a-699a26de50e3 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.796379 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-7f40196d-8a6a-4565-9800-db7245216d14 req-8f24ec88-ead3-4dea-ab8a-699a26de50e3 service nova] Creating event network-changed:48cf2d1d-960b-4b4f-896f-2de3f6ab663f for instance ef32f148-b349-40d9-9208-23365dc3f10b on hv-cinder-85426 Aug 24 03:44:35.802881 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-7f40196d-8a6a-4565-9800-db7245216d14 req-8f24ec88-ead3-4dea-ab8a-699a26de50e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038866 Aug 24 03:44:35.803972 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 554/1116] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:02.606838 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:46:02.607855 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Wed Aug 24 03:46:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:46:09.182462 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:46:09.183542 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:46:37.500474 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:46:37.501333 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:46:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:46:52.816851 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:46:52.817813 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:46:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:47:01.171670 dv-cinder-854260-1-smb devstack@n-api.service[127257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90b0be52-105e-41e6-9d4d-e7110ef780af] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 03:47:01.172628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=18 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:01.173257 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=34 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:01.178345 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:01.178929 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:01.186903 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.187399 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.187836 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.188557 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.189016 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.189451 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.216919 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.objects.instance [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lazy-loading 'flavor' on Instance uuid ef32f148-b349-40d9-9208-23365dc3f10b {{(pid=127257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:47:01.313667 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-4fe3fa46-5320-4de6-a910-88dc233df517 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "POST /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b/action" status: 202 len: 0 microversion: 2.1 time: 0.143633 Aug 24 03:47:01.314408 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 563/1117] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:47:01 2022] POST /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:47:01.323102 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17e34a91-ec3c-4142-b8d0-4b75b914834c] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:47:01.323958 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:01.324987 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=46 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:01.330714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:01.331553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:01.341645 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.342199 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.342896 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.343769 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.344417 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.345032 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.573256 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:01.591045 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-249f7fb0-f0a5-4fc4-8558-ac3c55c04aea tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.269617 Aug 24 03:47:01.592173 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 555/1118] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:01 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:02.628949 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:02.629713 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:02.639729 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:02.640403 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:02.640939 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:02.641726 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:02.642255 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:02.642792 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:02.650896 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] [90b0be52-105e-41e6-9d4d-e7110ef780af] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51390. Aug 24 03:47:02.808302 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:02.817364 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-f0a6d7c1-205e-4d2c-936c-416565c9b8e3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.195181 Aug 24 03:47:02.817974 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 564/1119] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:02 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:03.847629 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:03.848575 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:03.855763 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:03.856183 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:03.856614 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:03.857323 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:03.857771 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:03.858186 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:03.864553 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] [17e34a91-ec3c-4142-b8d0-4b75b914834c] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51394. Aug 24 03:47:04.033662 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:04.048462 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-4116da60-8d86-4631-91e9-c58f3ae7854d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.208765 Aug 24 03:47:04.049543 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 556/1120] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:03 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:05.086095 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:05.088108 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:05.095280 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:05.095832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:05.096317 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:05.097131 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:05.097715 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:05.098237 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:05.271770 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:05.281121 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-e5927134-be15-464c-a1e9-9a5061c329fe tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.199169 Aug 24 03:47:05.281758 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 565/1121] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:05 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:06.305469 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:06.307511 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:06.318515 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.319334 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.320052 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:06.321221 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.322957 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.323670 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:06.527316 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:06.536944 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-5d2a5e27-8c60-426b-8570-c72895a31781 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.237209 Aug 24 03:47:06.537706 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 557/1122] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:06 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:07.564559 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:07.565717 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:07.577753 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:07.578649 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:07.579478 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:07.580808 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:07.583183 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:07.584106 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:07.805056 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:07.818641 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-9e95d0a3-dd61-4e41-b66d-240e82e561da tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.261015 Aug 24 03:47:07.819509 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 566/1123] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:07 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:08.852176 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:08.853232 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:08.865382 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.866285 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.867122 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:08.868488 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.869347 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.870100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:09.112886 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:09.128292 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-12ea1fd3-1db3-4404-902e-2a5cb3dae9d2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.283423 Aug 24 03:47:09.129548 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 558/1124] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:08 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:10.172832 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:10.173727 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:10.181463 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:10.182052 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:10.182601 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:10.183421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:10.183950 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:10.184461 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:10.374860 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:10.385883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-cc12b25e-d6ff-492c-b8a0-4ab0ab8b8aa2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.216806 Aug 24 03:47:10.387013 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 567/1125] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:10 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:11.424779 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:11.425582 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:11.436605 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:11.437188 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:11.437858 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.439062 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:11.439780 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:11.440460 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.679660 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:11.693676 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-2ba7318e-337d-47f3-a773-77e8379a4fd3 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.274239 Aug 24 03:47:11.694630 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 559/1126] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:11 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:12.721898 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:12.722793 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:12.730628 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.731160 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.731566 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.732281 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.732764 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.733158 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.944835 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:12.955548 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-bc07040a-37ca-4ff4-8695-71f0f598e648 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.239604 Aug 24 03:47:12.956325 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 568/1127] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:12 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:13.993552 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:13.995539 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:14.004747 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.005371 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.005819 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.006685 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.007349 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.008013 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.242081 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:14.257563 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-502e4493-c579-484e-a90c-08a4447304ab tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.268600 Aug 24 03:47:14.258328 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 560/1128] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:13 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:15.283952 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:15.284679 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:15.292620 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.293154 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.293629 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.294320 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.294831 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.295258 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.509905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:15.526009 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-656dfe30-1f97-4353-ac16-beb5562339fc tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1507 microversion: 2.1 time: 0.246110 Aug 24 03:47:15.527112 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 569/1129] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:15 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:15.559033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:15.559796 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:15.569359 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.570061 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.570813 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.571902 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.572594 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.573255 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.783004 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127258) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:47:15.866694 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-0a8c14f6-abf4-4771-a119-eed5e9a1fa44 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "POST /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b/action" status: 202 len: 0 microversion: 2.1 time: 0.313055 Aug 24 03:47:15.870714 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 561/1130] 10.222.0.78 () {60 vars in 1278 bytes} [Wed Aug 24 03:47:15 2022] POST /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:47:15.878277 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:15.879212 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:15.887233 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.887821 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.888337 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.889231 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.889905 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.890485 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:16.098856 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:16.111058 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-67d96ed6-7456-4c28-adee-1f4abd454f8d tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1515 microversion: 2.1 time: 0.237305 Aug 24 03:47:16.111833 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 570/1131] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:15 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:17.137299 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:17.138627 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:17.146615 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.147164 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.147843 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:17.148470 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.149270 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.150140 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:17.348080 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:17.359436 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-d26a3fa3-f839-4e8f-829c-e566333205c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1517 microversion: 2.1 time: 0.228998 Aug 24 03:47:17.360216 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 562/1132] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:17 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:18.396122 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:18.397666 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:18.413197 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:18.414433 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:18.415605 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:18.417153 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:18.419223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:18.419223 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:18.471539 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-c7e23908-53b5-4fe2-bf1c-2394654fc9a1 req-6eb5d560-05b1-4a1a-b218-1974a4739d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32f148-b349-40d9-9208-23365dc3f10b", "name": "network-vif-unplugged", "status": "completed", "tag": "48cf2d1d-960b-4b4f-896f-2de3f6ab663f"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:18.496342 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c7e23908-53b5-4fe2-bf1c-2394654fc9a1 req-6eb5d560-05b1-4a1a-b218-1974a4739d3a service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:18.498177 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c7e23908-53b5-4fe2-bf1c-2394654fc9a1 req-6eb5d560-05b1-4a1a-b218-1974a4739d3a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:18.499529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-c7e23908-53b5-4fe2-bf1c-2394654fc9a1 req-6eb5d560-05b1-4a1a-b218-1974a4739d3a service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:18.525407 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-c7e23908-53b5-4fe2-bf1c-2394654fc9a1 req-6eb5d560-05b1-4a1a-b218-1974a4739d3a service nova] Creating event network-vif-unplugged:48cf2d1d-960b-4b4f-896f-2de3f6ab663f for instance ef32f148-b349-40d9-9208-23365dc3f10b on hv-cinder-85426 Aug 24 03:47:18.535119 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-c7e23908-53b5-4fe2-bf1c-2394654fc9a1 req-6eb5d560-05b1-4a1a-b218-1974a4739d3a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070574 Aug 24 03:47:18.537229 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 563/1133] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:18.668609 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:18.688431 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-61b0e062-d361-4307-9286-20463251eb73 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1573 microversion: 2.1 time: 0.299431 Aug 24 03:47:18.689779 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 571/1134] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:18 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1573 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:19.730386 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:19.731141 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:19.739409 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.739900 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.740355 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.741078 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.741541 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.741971 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.928246 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:19.943773 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6c8c57dd-24bd-4e42-9152-a3c2f66424d6 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1573 microversion: 2.1 time: 0.219334 Aug 24 03:47:19.944862 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 564/1135] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:19 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1573 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:20.981619 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:20.983368 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:20.993999 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.994553 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.995157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:20.995939 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.996409 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.996840 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:21.185848 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:21.198284 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-b8572220-52d6-4b64-85db-c93ebd719cb8 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1573 microversion: 2.1 time: 0.224607 Aug 24 03:47:21.200553 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 572/1136] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:20 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1573 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:22.225961 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:22.227205 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:22.239289 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:22.240143 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:22.240906 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:22.242130 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:22.243100 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:22.243860 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:22.481042 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:22.496581 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-6bf2d419-7379-4f82-b6b1-9559ef94774f tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1573 microversion: 2.1 time: 0.277639 Aug 24 03:47:22.497722 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 565/1137] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:22 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1573 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:23.535422 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:23.536360 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:23.546629 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:23.547536 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:23.548213 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:23.549259 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:23.549961 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:23.550633 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:23.746511 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:23.759634 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ddd2b313-002d-45d7-b5d8-5afd70c5c968 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1560 microversion: 2.1 time: 0.230009 Aug 24 03:47:23.760268 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 573/1138] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:23 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:24.547700 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-e5557521-9b41-4034-850c-adf79bae012a req-fda8847e-e24a-4885-817f-d0b9994cdcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32f148-b349-40d9-9208-23365dc3f10b", "name": "network-vif-plugged", "status": "completed", "tag": "48cf2d1d-960b-4b4f-896f-2de3f6ab663f"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:24.566604 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e5557521-9b41-4034-850c-adf79bae012a req-fda8847e-e24a-4885-817f-d0b9994cdcfd service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:24.567369 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e5557521-9b41-4034-850c-adf79bae012a req-fda8847e-e24a-4885-817f-d0b9994cdcfd service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:24.567934 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-e5557521-9b41-4034-850c-adf79bae012a req-fda8847e-e24a-4885-817f-d0b9994cdcfd service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:24.584168 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-e5557521-9b41-4034-850c-adf79bae012a req-fda8847e-e24a-4885-817f-d0b9994cdcfd service nova] Creating event network-vif-plugged:48cf2d1d-960b-4b4f-896f-2de3f6ab663f for instance ef32f148-b349-40d9-9208-23365dc3f10b on hv-cinder-85426 Aug 24 03:47:24.591726 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-e5557521-9b41-4034-850c-adf79bae012a req-fda8847e-e24a-4885-817f-d0b9994cdcfd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051410 Aug 24 03:47:24.592754 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 566/1139] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:03.817186 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_api:SELECT=22 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:03.822731 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG dbcounter [-] [127257] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:03.823731 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:03.824954 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG dbcounter [-] [127258] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:03.827583 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.828250 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.841266 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.842086 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.842902 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.844082 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.844880 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.845724 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.892528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Going to try to terminate instance {{(pid=127257) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:03.942364 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [req-a5b1a248-2da4-42ae-a6e2-6f3bb0c756fc req-845477ba-88da-46b1-9b52-fe6566c90778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef32f148-b349-40d9-9208-23365dc3f10b", "tag": "48cf2d1d-960b-4b4f-896f-2de3f6ab663f"}]} {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:03.959530 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a5b1a248-2da4-42ae-a6e2-6f3bb0c756fc req-845477ba-88da-46b1-9b52-fe6566c90778 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.960290 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a5b1a248-2da4-42ae-a6e2-6f3bb0c756fc req-845477ba-88da-46b1-9b52-fe6566c90778 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.960892 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [req-a5b1a248-2da4-42ae-a6e2-6f3bb0c756fc req-845477ba-88da-46b1-9b52-fe6566c90778 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.977848 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.compute.server_external_events [req-a5b1a248-2da4-42ae-a6e2-6f3bb0c756fc req-845477ba-88da-46b1-9b52-fe6566c90778 service nova] Creating event network-changed:48cf2d1d-960b-4b4f-896f-2de3f6ab663f for instance ef32f148-b349-40d9-9208-23365dc3f10b on hv-cinder-85426 Aug 24 03:49:03.986166 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [req-a5b1a248-2da4-42ae-a6e2-6f3bb0c756fc req-845477ba-88da-46b1-9b52-fe6566c90778 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166396 Aug 24 03:49:03.988067 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 567/1140] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:04.032157 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-ac829826-5a40-49eb-a901-04c54a435f64 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 204 len: 0 microversion: 2.1 time: 0.215925 Aug 24 03:49:04.033766 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 574/1141] 10.222.0.78 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:03 2022] DELETE /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:04.048940 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.052995 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.065657 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.066561 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.067442 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.069017 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.069885 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.070969 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.402449 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.421320 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-03da5492-0b07-44e6-98f6-f46f1fccc29e tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.381083 Aug 24 03:49:04.422419 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 568/1142] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:04 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:05.452493 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.453421 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.compute.api [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127257) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.464528 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.465358 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.466103 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.467698 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.468176 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.468883 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.749400 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.policy [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:05.759850 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-fd3582ca-4de8-43bd-ab44-3ac323b83336 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1566 microversion: 2.1 time: 0.311988 Aug 24 03:49:05.760547 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 575/1143] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1566 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:06.783228 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:06.784788 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:06.802622 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.803408 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.804163 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.805151 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.805732 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.806261 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.042134 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.policy [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abda0f0b14fe4e5f8a8af0525c2e0e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7ba12af984afda9b6d9ef80d4434f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127258) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.057950 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-7e7888c8-f2ca-47df-a46f-e10c62e5fa77 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 200 len: 1448 microversion: 2.1 time: 0.279125 Aug 24 03:49:07.067490 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 569/1144] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:06 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 1448 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:07.176508 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [req-42afb6c1-b2a4-4b84-a801-69bf1f872671 req-d0e4502c-b823-4a12-bbe0-2414b0b1f263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32f148-b349-40d9-9208-23365dc3f10b", "name": "network-vif-deleted", "tag": "48cf2d1d-960b-4b4f-896f-2de3f6ab663f"}]} {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:07.188711 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-42afb6c1-b2a4-4b84-a801-69bf1f872671 req-d0e4502c-b823-4a12-bbe0-2414b0b1f263 service nova] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.189262 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-42afb6c1-b2a4-4b84-a801-69bf1f872671 req-d0e4502c-b823-4a12-bbe0-2414b0b1f263 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.189754 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG oslo_concurrency.lockutils [req-42afb6c1-b2a4-4b84-a801-69bf1f872671 req-d0e4502c-b823-4a12-bbe0-2414b0b1f263 service nova] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.206065 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.compute.server_external_events [req-42afb6c1-b2a4-4b84-a801-69bf1f872671 req-d0e4502c-b823-4a12-bbe0-2414b0b1f263 service nova] Creating event network-vif-deleted:48cf2d1d-960b-4b4f-896f-2de3f6ab663f for instance ef32f148-b349-40d9-9208-23365dc3f10b on hv-cinder-85426 Aug 24 03:49:07.213150 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [req-42afb6c1-b2a4-4b84-a801-69bf1f872671 req-d0e4502c-b823-4a12-bbe0-2414b0b1f263 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157193 Aug 24 03:49:07.213676 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 576/1145] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:08.093976 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '>' {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.094963 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.compute.api [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] [instance: ef32f148-b349-40d9-9208-23365dc3f10b] Fetching instance by UUID {{(pid=127258) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.106269 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.106815 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.107362 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.108510 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Acquiring lock "97a45c54-1fe5-4470-83ef-9fef2d361903" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.109274 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.109697 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG oslo_concurrency.lockutils [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Lock "97a45c54-1fe5-4470-83ef-9fef2d361903" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127258) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.126623 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.wsgi [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] HTTP exception thrown: Instance ef32f148-b349-40d9-9208-23365dc3f10b could not be found. Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Request method failure captured: Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: request: GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b HTTP/1.1 Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept: application/json Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Accept-Encoding: identity Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Connection: close Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Length: 0 Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Content-Type: application/json Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Host: 10.222.0.78 Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Openstack-System-Scope: None Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Auth-Token: gAAAAABjBZ5sw5RpwiRPNr3RPlto8IDdcLYQibYF5Vee1Hp2DD6f_nqP0gkhetRyxV-XUsCbVtFjp26X8ba0pX7wkLYv0LlKT_PfT0kkZOLzjdlI54MFD6eDHIa0i38r7_k1b_q8zKFMYiZXe0dIz6rvnOL8vXPg6xssGOW6Ci3rD4iNEFuaGKA Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Id: None Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Domain-Name: None Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Identity-Status: Confirmed Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Is-Admin-Project: True Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Id: default Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Domain-Name: Default Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Id: 27a7ba12af984afda9b6d9ef80d4434f Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Project-Name: tempest-TestShelveInstance-98778204 Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Role: reader,member Aug 24 03:49:08.128529 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Roles: reader,member Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27a7ba12af984afda9b6d9ef80d4434f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27a7ba12af984afda9b6d9ef80d4434f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27a7ba12af984afda9b6d9ef80d4434f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27a7ba12af984afda9b6d9ef80d4434f"}]}] Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant: tempest-TestShelveInstance-98778204 Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Id: 27a7ba12af984afda9b6d9ef80d4434f Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-Tenant-Name: tempest-TestShelveInstance-98778204 Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User: tempest-TestShelveInstance-98778204-project Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Id: default Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Domain-Name: Default Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Id: abda0f0b14fe4e5f8a8af0525c2e0e62 Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: X-User-Name: tempest-TestShelveInstance-98778204-project Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: method: > Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: exception: Instance ef32f148-b349-40d9-9208-23365dc3f10b could not be found. Aug 24 03:49:08.130360 dv-cinder-854260-1-smb devstack@n-api.service[127258]: action_args: {'id': 'ef32f148-b349-40d9-9208-23365dc3f10b'} Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: {{(pid=127258) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef32f148-b349-40d9-9208-23365dc3f10b could not be found. Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:08.131397 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef32f148-b349-40d9-9208-23365dc3f10b could not be found. Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef32f148-b349-40d9-9208-23365dc3f10b could not be found. Aug 24 03:49:08.137050 dv-cinder-854260-1-smb devstack@n-api.service[127258]: ERROR nova.api.openstack.wsgi Aug 24 03:49:08.139823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: DEBUG nova.api.openstack.wsgi [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Returning 404 to user: Instance ef32f148-b349-40d9-9208-23365dc3f10b could not be found. {{(pid=127258) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:08.139823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO nova.api.openstack.requestlog [None req-3e2a55bd-7bae-4050-b72f-baffdfbcb0c2 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b" status: 404 len: 111 microversion: 2.1 time: 0.041071 Aug 24 03:49:08.139823 dv-cinder-854260-1-smb devstack@n-api.service[127258]: [pid: 127258|app: 0|req: 570/1146] 10.222.0.78 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/ef32f148-b349-40d9-9208-23365dc3f10b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:08.372111 dv-cinder-854260-1-smb devstack@n-api.service[127257]: DEBUG nova.api.openstack.wsgi [None req-6f18268f-77af-455f-a5d1-104e49dac1c5 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] Calling method '.version_select at 0x7f4f443fdd30>' {{(pid=127257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.412560 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO nova.api.openstack.requestlog [None req-6f18268f-77af-455f-a5d1-104e49dac1c5 tempest-TestShelveInstance-98778204 tempest-TestShelveInstance-98778204-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-199082765" status: 202 len: 0 microversion: 2.1 time: 0.044619 Aug 24 03:49:08.413955 dv-cinder-854260-1-smb devstack@n-api.service[127257]: [pid: 127257|app: 0|req: 577/1147] 10.222.0.78 () {58 vars in 1251 bytes} [Wed Aug 24 03:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-199082765 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:49:22.621033 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:49:22.621709 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Wed Aug 24 03:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:49:36.375197 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:49:36.376233 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Wed Aug 24 03:49:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:49:57.511412 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:49:57.512382 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:49:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:51:09.195738 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:51:09.196855 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:51:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:51:37.813515 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:51:37.814476 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Wed Aug 24 03:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:51:52.830590 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:51:52.831318 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:52:42.638958 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:52:42.639895 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Wed Aug 24 03:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:52:56.387540 dv-cinder-854260-1-smb devstack@n-api.service[127258]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:52:56.388683 dv-cinder-854260-1-smb devstack@n-api.service[127258]: Wed Aug 24 03:52:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:53:17.524502 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:53:17.525411 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:53:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:54:29.206503 dv-cinder-854260-1-smb devstack@n-api.service[127257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:54:29.207772 dv-cinder-854260-1-smb devstack@n-api.service[127257]: Wed Aug 24 03:54:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!